00000001:02000400:1.0F:1788918356.526017:0:3093:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788918365.170742:0:3295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1788918366.020465:0:3357:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1407 MB/s 00000001:01000000:1.0:1788918366.270369:0:3357:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1487 MB/s 00000001:01000000:1.0:1788918366.520120:0:3357:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10775 MB/s 00000020:02000000:0.0:1788918366.837936:0:3386:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g8df9471 00000400:02000000:2.0:1788918367.251942:0:3401:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.149@tcp [8/256/0/180] 00008000:02000000:0.0:1788918369.562945:0:3551:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788918392.496436:0:5152:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788918403.489353:0:5901:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788918403.489360:0:5901:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788918403.489361:0:5901:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788918403.489506:0:5901:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d32bc5b9 00000080:02000400:0.0:1788918403.489517:0:5901:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788918403.494877:0:5901:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788918403.494888:0:5901:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788918403.494922:0:5901:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000035455e2) 00000020:00000080:0.0:1788918403.494940:0:5901:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788918403.541528:0:5901:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788918403.541652:0:5901:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788918403.553229:0:5901:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788918403.553438:0:5901:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788918403.553444:0:5901:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788918403.553454:0:5901:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac89a8 00000020:01000004:0.0:1788918403.553459:0:5901:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788918403.553463:0:5901:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788918403.553466:0:5901:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d32bc5b9 from MGS 00000020:01000004:0.0:1788918403.553470:0:5901:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788918403.553478:0:5901:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000035bd0d92) 00000020:00000080:0.0:1788918403.553486:0:5901:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788918403.553536:0:5901:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d32bc5b9 from MGS, refs=2 00080000:01000000:0.0:1788918403.553541:0:5901:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788918403.553544:0:5901:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac89b6 00000100:00100000:0.0:1788918403.553747:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788918403.553860:0:5901:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788918403.553865:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788918403.555272:0:5901:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788918403.555279:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788918403.556684:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918403.556842:0:5901:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788918403.556852:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788918403.557482:0:5901:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788918403.557488:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788918403.557885:0:5901:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788918403.557891:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788918403.558862:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918403.558866:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918403.558867:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918403.559302:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918403.559304:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918403.559306:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918403.559818:0:5901:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0F:1788918403.561514:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788918403.809119:0:5901:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5347 MB/s 00000001:01000000:2.0:1788918404.059330:0:5901:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5619 MB/s 00000001:01000000:3.0:1788918404.309826:0:5901:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 955 MB/s 00000001:01000000:2.0:1788918404.559118:0:5901:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1171 MB/s 00010000:00010000:3.0:1788918404.566280:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788918404.567722:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1788918404.588889:0:5901:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788918404.591479:0:5915:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788918404.591531:0:5901:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788918404.591575:0:5901:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788918404.591767:0:5901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788918404.591786:0:5901:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788918404.592208:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788918404.592339:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788918404.592344:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788918404.593258:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788918404.593266:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788918404.593748:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788918404.593755:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788918404.605840:0:5901:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788918404.605861:0:5901:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.149@tcp' 00000020:01000004:3.0:1788918404.605863:0:5901:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788918404.605912:0:5901:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.149@tcp (typ=mgc) 00000020:00000080:3.0:1788918404.605933:0:5901:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.149@tcp (000000004cc78df0) 00000020:00000080:3.0:1788918404.605948:0:5901:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788918404.606067:0:5901:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e0a62b68@MGC192.168.202.149@tcp: add connection 192.168.202.149@tcp at head 00010000:00010000:3.0:1788918404.606219:0:5901:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.149@tcp-0 is initialized 00000040:01000000:3.0:1788918404.606224:0:5901:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788918404.613321:0:5921:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788918404.613794:0:5901:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.149@tcp (uuid 74aa73a2-313d-4992-b461-72ab8c3ab246) 00000020:00000080:3.0:1788918404.613814:0:5901:0:(genops.c:1385:class_connect()) connect: client 74aa73a2-313d-4992-b461-72ab8c3ab246, cookie 0x2811b8b2b0ac89c4 00000100:00080000:3.0:1788918404.613824:0:5901:0:(import.c:545:import_select_connection()) MGC192.168.202.149@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788918404.613828:0:5901:0:(import.c:665:import_select_connection()) MGC192.168.202.149@tcp: import 00000000e0a62b68 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788918404.613866:0:5901:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e99137f6 x1875816865595520/t0(0) o250->MGC192.168.202.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788918404.613934:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e99137f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74aa73a2-313d-4992-b461-72ab8c3ab246:3416:1875816865595520:0@lo:250: 00000100:00100000:3.0:1788918404.613984:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788918404.614049:0:5901:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 74aa73a2-313d-4992-b461-72ab8c3ab246->MGS 00000020:01000004:3.0:1788918404.614066:0:5901:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788918404.614092:0:5901:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788918404.614103:0:5901:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e7fb9aaa) 00000020:00000080:3.0:1788918404.614121:0:5901:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788918404.616680:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865595520 00000100:00100000:1.0:1788918404.616694:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865595520 00000100:00100000:1.0:1788918404.616735:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788918404.616742:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fcce0d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3416:x1875816865595520:12345-0@lo:250: 00010000:00080000:1.0:1788918404.616766:0:5916:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 74aa73a2-313d-4992-b461-72ab8c3ab246@0@lo t0 exp 0000000000000000 cur 106 last 0 00000020:00000080:1.0:1788918404.616790:0:5916:0:(genops.c:1385:class_connect()) connect: client 74aa73a2-313d-4992-b461-72ab8c3ab246, cookie 0x2811b8b2b0ac89d2 00000100:00080000:1.0:1788918404.616906:0:5916:0:(import.c:65:import_set_state_nolock()) 0000000056e14580 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788918404.616967:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fcce0d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+5:3416:x1875816865595520:12345-0@lo:250: Request processed in 225us (2983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918404.616974:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788918404.617497:0:3416:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.149@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788918404.617507:0:3416:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.149@tcp: connect to target with instance 0 00000100:00080000:2.0:1788918404.617515:0:3416:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.149@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788918404.617520:0:3416:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788918404.617522:0:3416:0:(import.c:65:import_set_state_nolock()) 00000000e0a62b68 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788918404.617526:0:3416:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788918404.617533:0:3416:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788918404.617538:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e99137f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74aa73a2-313d-4992-b461-72ab8c3ab246:3416:1875816865595520:0@lo:250: 00000100:00080000:2.0:1788918404.617609:0:5920:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788918404.628976:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788918404.629184:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788918404.629189:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788918404.631262:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788918404.631271:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788918404.631604:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788918404.631610:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788918404.632207:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918404.632379:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788918404.632384:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788918404.632964:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788918404.632970:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788918404.674803:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918404.675352:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788918404.675379:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788918404.676471:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788918404.676479:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788918404.677321:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918404.677583:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788918404.677589:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788918404.678336:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788918404.678342:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788918404.678978:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918404.679996:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788918404.680002:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788918404.680933:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788918404.680941:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788918404.681787:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788918404.681944:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788918404.681949:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788918404.685625:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788918404.685638:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788918404.700424:0:5901:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788918404.700610:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788918404.700626:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788918404.706396:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788918404.706411:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788918404.707145:0:5901:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788918404.707152:0:5901:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788918404.707847:0:5901:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788918404.707870:0:5901:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788918404.707875:0:5901:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.149@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788918404.707962:0:5901:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788918404.707990:0:5901:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.149@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788918404.707994:0:5901:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788918404.707996:0:5901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788918404.707997:0:5901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788918404.707998:0:5901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788918404.707999:0:5901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788918404.708000:0:5901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788918404.708001:0:5901:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788918404.708003:0:5901:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788918404.708004:0:5901:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788918404.708005:0:5901:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788918404.708006:0:5901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788918404.708008:0:5901:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788918404.708010:0:5901:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788918404.708128:0:5901:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788918404.708130:0:5901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788918404.708131:0:5901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788918404.708132:0:5901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788918404.708133:0:5901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788918404.708134:0:5901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788918404.708135:0:5901:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788918404.708136:0:5901:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788918404.708137:0:5901:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788918404.708138:0:5901:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788918404.708139:0:5901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788918404.708140:0:5901:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788918404.708171:0:5901:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788918404.708186:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000620ab2da pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865595648:0@lo:253: 00000100:00100000:3.0:1788918404.708244:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918404.708408:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f7d3d44 going to sleep for 11 seconds 00000100:00100000:2.0:1788918404.708447:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865595648 00000100:00100000:2.0:1788918404.708455:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865595648 00000100:00100000:2.0:1788918404.708530:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788918404.708538:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029520db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+5:5901:x1875816865595648:12345-0@lo:253: 20000000:01000000:2.0:1788918404.708579:0:5918:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788918404.708582:0:5918:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788918404.708817:0:5940:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788918404.708848:0:5918:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788918404.715261:0:5918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788918404.716669:0:5941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788918404.716889:0:5918:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788918404.716893:0:5918:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788918404.716898:0:5918:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788918404.716908:0:5918:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788918404.716920:0:5918:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788918404.717163:0:5918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788918404.717377:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788918404.717390:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788918404.717405:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788918404.717430:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788918404.717444:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788918404.717488:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788918404.717495:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788918404.717506:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788918404.717510:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788918404.717520:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788918404.717524:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788918404.717534:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788918404.717546:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788918404.717569:0:5918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788918404.717573:0:5918:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788918404.717580:0:5918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788918404.717670:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788918404.717679:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788918404.717692:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788918404.717704:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788918404.717715:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788918404.717722:0:5918:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788918404.717742:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788918404.717748:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788918404.717758:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788918404.717770:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788918404.717782:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788918404.717788:0:5918:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788918404.717805:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788918404.717818:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788918404.717837:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788918404.717851:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788918404.717894:0:5918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788918404.717909:0:5918:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788918404.717916:0:5918:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788918404.723231:0:5942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788918404.723551:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788918404.723577:0:5918:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.149@tcp for mdt 20000000:01000000:3.0:1788918404.723580:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.149@tcp (null) (null) (null) 00000040:00080000:3.0:1788918404.723596:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788918404.723604:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788918404.723616:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788918404.723622:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.149@tcp (null) (null) 00000040:00080000:3.0:1788918404.723635:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788918404.723642:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788918404.723654:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788918404.723668:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788918404.723694:0:5918:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788918404.723697:0:5918:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788918404.723701:0:5918:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788918404.723763:0:5918:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788918404.723766:0:5918:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788918404.724017:0:5943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788918404.724229:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788918404.724254:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788918404.724265:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788918404.724273:0:5918:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788918404.724275:0:5918:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788918404.724552:0:5944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788918404.724675:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788918404.724692:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788918404.724704:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1788918404.724716:0:5918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788918404.724718:0:5918:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788918404.724722:0:5918:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788918404.724723:0:5918:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788918404.724727:0:5918:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788918404.724732:0:5918:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788918404.724989:0:5945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788918404.725194:0:5918:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788918404.733659:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788918404.733697:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788918404.733712:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788918404.733732:0:5918:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788918404.733753:0:5918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.733769:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89d9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.733779:0:5918:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.733785:0:5918:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.733791:0:5918:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89d9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.733803:0:5918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.733809:0:5918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000048ec9493 already unused, calling callback (00000000872d93ee) 00010000:00010000:3.0:1788918404.733813:0:5918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.733820:0:5918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.733832:0:5918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89d9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.733839:0:5918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.733845:0:5918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89d9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788918404.733861:0:5918:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788918404.752342:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029520db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+5:5901:x1875816865595648:12345-0@lo:253: Request processed in 43798us (44091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918404.752371:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788918404.752572:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000620ab2da pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865595648:0@lo:253: 10000000:01000000:0.0:1788918404.752587:0:5901:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788918404.752603:0:5901:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788918404.752604:0:5901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788918404.752606:0:5901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788918404.752607:0:5901:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788918404.752608:0:5901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788918404.752609:0:5901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788918404.752611:0:5901:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788918404.752612:0:5901:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788918404.752614:0:5901:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788918404.752615:0:5901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788918404.752616:0:5901:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788918404.752633:0:5901:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d32bc5b9 from lustre-MDT0000 10000000:01000000:0.0:1788918404.752661:0:5901:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788918404.752664:0:5901:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788918404.752667:0:5901:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff94fffbddcd40 10000000:01000000:0.0:1788918404.752671:0:5901:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788918404.752678:0:5901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94fffbddcd40 from 1 10000000:01000000:0.0:1788918404.752681:0:5901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788918404.752725:0:5901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 000000000b7fa05f/0x2811b8b2b0ac89e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.752735:0:5901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 000000000b7fa05f/0x2811b8b2b0ac89e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.752743:0:5901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 000000000b7fa05f/0x2811b8b2b0ac89e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918404.752758:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c91e3f1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865595776:0@lo:101: 00000100:00100000:0.0:1788918404.752805:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918404.752855:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ded40c74 going to sleep for 11 seconds 00000100:00100000:2.0:1788918404.752915:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865595776 00000100:00100000:2.0:1788918404.752922:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865595776 00000100:00100000:2.0:1788918404.752959:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788918404.752965:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079d121d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+5:5901:x1875816865595776:12345-0@lo:101: 00010000:00010000:2.0:1788918404.752977:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918404.752989:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000099b1d8f6/0x2811b8b2b0ac89e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac89e0 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.753008:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000099b1d8f6/0x2811b8b2b0ac89e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac89e0 expref: 6 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.753017:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000099b1d8f6/0x2811b8b2b0ac89e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac89e0 expref: 6 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.753047:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000099b1d8f6, rc 0) 00000100:00100000:2.0:1788918404.753083:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079d121d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+6:5901:x1875816865595776:12345-0@lo:101: Request processed in 118us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918404.753089:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788918404.753195:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c91e3f1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865595776:0@lo:101: 00010000:00010000:0.0:1788918404.753257:0:5901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 000000000b7fa05f/0x2811b8b2b0ac89e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac89e7 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.753275:0:5901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 000000000b7fa05f/0x2811b8b2b0ac89e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac89e7 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918404.753445:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c91e3f1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865595904:0@lo:501: 00000100:00100000:0.0:1788918404.753469:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918404.753493:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ded40c74 going to sleep for 11 seconds 00000100:00100000:3.0:1788918404.753542:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865595904 00000100:00100000:3.0:1788918404.753546:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865595904 00000100:00100000:3.0:1788918404.753574:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788918404.753580:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080152529 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+6:5901:x1875816865595904:12345-0@lo:501: 00000100:00100000:3.0:1788918404.753649:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080152529 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+6:5901:x1875816865595904:12345-0@lo:501: Request processed in 70us (180us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788918404.753664:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788918404.753759:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c91e3f1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865595904:0@lo:501: 10000000:01000000:0.0:1788918404.753783:0:5901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788918404.753800:0:5901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 000000000b7fa05f/0x2811b8b2b0ac89e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac89e7 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.753807:0:5901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 000000000b7fa05f/0x2811b8b2b0ac89e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac89e7 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918404.753813:0:5901:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94fffbe70000 10000000:01000000:0.0:1788918404.753816:0:5901:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788918404.753820:0:5901:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94fffbe70000 10000000:01000000:0.0:1788918404.753822:0:5901:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788918404.753824:0:5901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff94fffbe70000 from 1 10000000:01000000:0.0:1788918404.753825:0:5901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788918404.753838:0:5901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 000000003a810691/0x2811b8b2b0ac89ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.753843:0:5901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 000000003a810691/0x2811b8b2b0ac89ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.753849:0:5901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 000000003a810691/0x2811b8b2b0ac89ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918404.753869:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c91e3f1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865596032:0@lo:101: 00000100:00100000:0.0:1788918404.753893:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918404.753912:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ded40c74 going to sleep for 11 seconds 00000100:00100000:3.0:1788918404.753993:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865596032 00000100:00100000:3.0:1788918404.753997:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865596032 00000100:00100000:3.0:1788918404.754047:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788918404.754053:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a24c157 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+6:5901:x1875816865596032:12345-0@lo:101: 00010000:00010000:3.0:1788918404.754059:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918404.754068:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac89ee expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.754080:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac89ee expref: 7 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.754087:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000048ec9493/0x2811b8b2b0ac89f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac89ee expref: 7 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.754093:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000048ec9493, rc 0) 00000100:00100000:3.0:1788918404.754118:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a24c157 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+7:5901:x1875816865596032:12345-0@lo:101: Request processed in 66us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918404.754124:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788918404.754188:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c91e3f1f pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865596032:0@lo:101: 00010000:00010000:2.0:1788918404.754196:0:5901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 000000003a810691/0x2811b8b2b0ac89ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.754213:0:5901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 000000003a810691/0x2811b8b2b0ac89ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918404.754231:0:5901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788918404.754243:0:5901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 000000003a810691/0x2811b8b2b0ac89ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.754248:0:5901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 000000003a810691/0x2811b8b2b0ac89ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918404.754254:0:5901:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788918404.754257:0:5901:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788918404.754261:0:5901:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94fffbe70000 10000000:01000000:2.0:1788918404.754263:0:5901:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788918404.754265:0:5901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788918404.754267:0:5901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788918404.754519:0:5901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 00000000c23b0d9c/0x2811b8b2b0ac89fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.754527:0:5901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 00000000c23b0d9c/0x2811b8b2b0ac89fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.754534:0:5901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 00000000c23b0d9c/0x2811b8b2b0ac89fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918404.754545:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d20c5cc7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865596160:0@lo:101: 00000100:00100000:2.0:1788918404.754571:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918404.754596:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e26ed05a going to sleep for 11 seconds 00000100:00100000:3.0:1788918404.754647:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865596160 00000100:00100000:3.0:1788918404.754651:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865596160 00000100:00100000:3.0:1788918404.754677:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788918404.754683:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067d43573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+7:5901:x1875816865596160:12345-0@lo:101: 00010000:00010000:3.0:1788918404.754689:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918404.754695:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004c7fab42/0x2811b8b2b0ac8a03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac89fc expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.754707:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c7fab42/0x2811b8b2b0ac8a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac89fc expref: 8 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.754719:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004c7fab42/0x2811b8b2b0ac8a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac89fc expref: 8 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.754725:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004c7fab42, rc 0) 00000100:00100000:3.0:1788918404.754748:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067d43573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+8:5901:x1875816865596160:12345-0@lo:101: Request processed in 66us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918404.754754:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788918404.754820:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d20c5cc7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865596160:0@lo:101: 00010000:00010000:2.0:1788918404.754829:0:5901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 00000000c23b0d9c/0x2811b8b2b0ac89fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a03 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.754845:0:5901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 00000000c23b0d9c/0x2811b8b2b0ac89fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8a03 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918404.754883:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d20c5cc7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865596288:0@lo:501: 00000100:00100000:2.0:1788918404.754906:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918404.754925:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e26ed05a going to sleep for 11 seconds 00000100:00100000:3.0:1788918404.754976:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865596288 00000100:00100000:3.0:1788918404.754980:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865596288 00000100:00100000:3.0:1788918404.755005:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788918404.755010:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bf0af83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+8:5901:x1875816865596288:12345-0@lo:501: 00000100:00100000:3.0:1788918404.755108:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bf0af83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+9:5901:x1875816865596288:12345-0@lo:501: Request processed in 98us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918404.755115:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788918404.760274:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d20c5cc7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865596288:0@lo:501: 00000100:00100000:2.0:1788918404.760349:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d20c5cc7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865596416:0@lo:503: 00000100:00100000:2.0:1788918404.760428:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918404.760474:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e26ed05a going to sleep for 11 seconds 00000100:00100000:3.0:1788918404.760567:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865596416 00000100:00100000:3.0:1788918404.760574:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865596416 00000100:00100000:3.0:1788918404.760622:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788918404.760630:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044d0bc67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+9:5901:x1875816865596416:12345-0@lo:503: 00000100:00100000:3.0:1788918404.760724:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044d0bc67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+9:5901:x1875816865596416:12345-0@lo:503: Request processed in 94us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918404.760731:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788918404.760818:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d20c5cc7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865596416:0@lo:503: 00000100:00100000:2.0:1788918404.761880:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d20c5cc7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:5946:1875816865596544:0@lo:502: 00000100:00100000:2.0:1788918404.761919:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918404.761946:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ddb0318 going to sleep for 11 seconds 00000100:00100000:3.0:1788918404.761994:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865596544 00000100:00100000:3.0:1788918404.761999:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865596544 00000100:00100000:3.0:1788918404.762038:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788918404.762044:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1fe6ac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+9:5946:x1875816865596544:12345-0@lo:502: 00000100:00100000:3.0:1788918404.762124:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1fe6ac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+9:5946:x1875816865596544:12345-0@lo:502: Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918404.762136:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788918404.762316:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d20c5cc7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:5946:1875816865596544:0@lo:502: 00000020:01000000:0.0:1788918404.762337:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788918404.762347:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918404.762349:0:5946:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788918404.762355:0:5946:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788918404.762366:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788918404.762379:0:5946:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000036a02105) 00000020:00000080:0.0:1788918404.762395:0:5946:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788918404.762401:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788918404.762476:0:5946:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788918404.762482:0:5946:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac8a11 00000020:00000080:0.0:1788918404.762683:0:5946:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788918404.762687:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788918404.762690:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918404.762691:0:5946:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788918404.762694:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788918404.762697:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918404.762698:0:5946:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788918404.762701:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788918404.762708:0:5946:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001787df02) 00000020:00000080:0.0:1788918404.762716:0:5946:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788918404.762719:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788918404.762721:0:5946:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788918404.762724:0:5946:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788918404.762729:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788918404.762761:0:5946:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d32bc5b9 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788918404.762778:0:5946:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000de25994f) 00000020:00000080:0.0:1788918404.762788:0:5946:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788918404.762838:0:5946:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788918404.762842:0:5946:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2811b8b2b0ac8a26 00000020:00000080:0.0:1788918404.762936:0:5946:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788918404.762942:0:5946:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788918404.762946:0:5946:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2811b8b2b0ac8a2d 00080000:01000000:0.0:1788918404.762950:0:5946:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788918404.762953:0:5946:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac8a34 00080000:10000000:0.0:1788918404.763731:0:5946:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788918404.763881:0:5946:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788918404.769773:0:5946:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788918404.864312:0:5946:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788918404.864637:0:5946:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788918404.869965:0:5946:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788918404.871268:0:5946:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788918404.873945:0:5946:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e0b6d17a) 00000020:00000080:3.0:1788918404.873963:0:5946:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788918404.874061:0:5946:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788918404.874079:0:5946:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac8a42 00000020:00000080:0.0:1788918404.878650:0:5946:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788918404.881653:0:5946:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788918404.892421:0:5946:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788918404.894532:0:5946:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788918404.896714:0:5946:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788918404.905868:0:5946:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788918404.911518:0:5946:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1788918404.914309:0:5946:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2811b8b2b0ac8a49 00000020:00000080:2.0:1788918404.914734:0:5946:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788918404.914745:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918404.914751:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918404.914754:0:5946:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788918404.914757:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918404.914761:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918404.914762:0:5946:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788918404.914765:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788918404.914767:0:5946:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788918404.914770:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918404.914772:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918404.914773:0:5946:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788918404.914775:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918404.914787:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918404.914788:0:5946:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788918404.914793:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788918404.914835:0:5946:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788918404.914888:0:5946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005880c81c pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:5946:1875816865596672:0@lo:502: 00000100:00100000:2.0:1788918404.914959:0:5946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918404.915073:0:5946:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b082b16 going to sleep for 11 seconds 00000100:00100000:0.0:1788918404.915523:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865596672 00000100:00100000:0.0:1788918404.915532:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865596672 00000100:00100000:0.0:1788918404.915584:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788918404.915593:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e799495 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+9:5946:x1875816865596672:12345-0@lo:502: 00000100:00100000:0.0:1788918404.915713:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e799495 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+9:5946:x1875816865596672:12345-0@lo:502: Request processed in 121us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918404.915720:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788918404.915816:0:5946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005880c81c pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:5946:1875816865596672:0@lo:502: 00000020:01000000:2.0:1788918404.915840:0:5946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918404.915844:0:5946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918404.915846:0:5946:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788918404.915849:0:5946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788918404.915974:0:5901:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788918404.915993:0:5901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788918404.916010:0:5901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 00000000c23b0d9c/0x2811b8b2b0ac89fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a03 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.916045:0:5901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 00000000c23b0d9c/0x2811b8b2b0ac89fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a03 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918404.916053:0:5901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94fffbe70000 from 1 10000000:01000000:0.0:1788918404.916055:0:5901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788918404.916079:0:5901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.916092:0:5901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.916100:0:5901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918404.916113:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2d8da9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865596800:0@lo:101: 00000100:00100000:0.0:1788918404.916140:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918404.916161:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 000000004b46d390 going to sleep for 11 seconds 00000100:00100000:2.0:1788918404.918636:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865596800 00000100:00100000:2.0:1788918404.918647:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865596800 00000100:00100000:2.0:1788918404.918690:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788918404.918698:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6ec615d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+9:5901:x1875816865596800:12345-0@lo:101: 00010000:00010000:2.0:1788918404.918712:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918404.918727:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000022817004/0x2811b8b2b0ac8a57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8a50 expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.918752:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022817004/0x2811b8b2b0ac8a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8a50 expref: 10 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.918763:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000022817004/0x2811b8b2b0ac8a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8a50 expref: 10 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.918771:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000022817004, rc 0) 00000100:00100000:2.0:1788918404.918821:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6ec615d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+10:5901:x1875816865596800:12345-0@lo:101: Request processed in 125us (2681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918404.918841:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788918404.918878:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2d8da9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865596800:0@lo:101: 00010000:00010000:0.0:1788918404.918893:0:5901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a57 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.918903:0:5901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8a57 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918404.919493:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2d8da9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865596928:0@lo:256: 00000100:00100000:0.0:1788918404.919533:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918404.919566:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 000000004b46d390 going to sleep for 11 seconds 00000100:00100000:3.0:1788918404.919577:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865596928 00000100:00100000:3.0:1788918404.919581:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865596928 00000100:00100000:3.0:1788918404.919616:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788918404.919623:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c4f4711 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+10:5901:x1875816865596928:12345-0@lo:256: 20000000:01000000:3.0:1788918404.919637:0:5918:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788918404.919642:0:5918:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788918404.923564:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c4f4711 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+10:5901:x1875816865596928:12345-0@lo:256: Request processed in 3933us (4022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918404.923579:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788918404.925176:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2d8da9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865596928:0@lo:256: 10000000:01000000:0.0:1788918404.925822:0:5901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788918404.925843:0:5901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a57 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.925852:0:5901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a57 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918404.925874:0:5901:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94fffbe70000 from 1 10000000:01000000:0.0:1788918404.925877:0:5901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788918404.925910:0:5901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.925918:0:5901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.925926:0:5901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918404.925943:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2d8da9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865597056:0@lo:101: 00000100:00100000:0.0:1788918404.925996:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918404.926061:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 000000004b46d390 going to sleep for 11 seconds 00000100:00100000:2.0:1788918404.926097:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865597056 00000100:00100000:2.0:1788918404.926103:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865597056 00000100:00100000:2.0:1788918404.926142:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788918404.926149:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8cb51ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+10:5901:x1875816865597056:12345-0@lo:101: 00010000:00010000:2.0:1788918404.926161:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918404.926190:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a42c841c/0x2811b8b2b0ac8a65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8a5e expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.926220:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a42c841c/0x2811b8b2b0ac8a65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8a5e expref: 11 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.926231:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a42c841c/0x2811b8b2b0ac8a65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8a5e expref: 11 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.926238:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a42c841c, rc 0) 00000100:00100000:2.0:1788918404.926279:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8cb51ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+11:5901:x1875816865597056:12345-0@lo:101: Request processed in 131us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918404.926285:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788918404.926310:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2d8da9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865597056:0@lo:101: 00010000:00010000:0.0:1788918404.926321:0:5901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a65 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.926329:0:5901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8a65 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918404.926388:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2d8da9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865597184:0@lo:501: 00000100:00100000:0.0:1788918404.926414:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918404.926471:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 000000004b46d390 going to sleep for 11 seconds 00000100:00100000:2.0:1788918404.926507:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865597184 00000100:00100000:2.0:1788918404.926511:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865597184 00000100:00100000:2.0:1788918404.926574:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788918404.926581:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d683f16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+11:5901:x1875816865597184:12345-0@lo:501: 00000100:00100000:2.0:1788918404.926810:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d683f16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+11:5901:x1875816865597184:12345-0@lo:501: Request processed in 229us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918404.926817:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788918404.929465:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2d8da9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865597184:0@lo:501: 00000100:00100000:1.0:1788918404.929556:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063e1c28b pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865597312:0@lo:503: 00000100:00100000:1.0:1788918404.929617:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918404.930094:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da120e4c going to sleep for 11 seconds 00000100:00100000:3.0:1788918404.934277:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865597312 00000100:00100000:3.0:1788918404.934294:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865597312 00000100:00100000:2.0:1788918404.934404:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788918404.934414:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d12cca70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+11:5901:x1875816865597312:12345-0@lo:503: 00000040:00080000:2.0:1788918404.934483:0:5916:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788918404.934632:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d12cca70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+11:5901:x1875816865597312:12345-0@lo:503: Request processed in 220us (5015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918404.934641:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788918404.934725:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063e1c28b pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865597312:0@lo:503: 00000040:00080000:2.0:1788918404.937170:0:5950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788918404.937340:0:5901:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788918404.937383:0:5901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788918404.937444:0:5901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a65 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.937455:0:5901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a65 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918404.937504:0:5901:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788918404.937507:0:5901:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94fffbe70000 10000000:01000000:0.0:1788918404.937510:0:5901:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94fffbe70000 10000000:01000000:0.0:1788918404.937513:0:5901:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788918404.937519:0:5901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94fffbe70000 from 1 10000000:01000000:0.0:1788918404.937521:0:5901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788918404.937552:0:5901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 00000000c962424c/0x2811b8b2b0ac8a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.937559:0:5901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 00000000c962424c/0x2811b8b2b0ac8a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.937569:0:5901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 00000000c962424c/0x2811b8b2b0ac8a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918404.937587:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033068768 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865597440:0@lo:101: 00000100:00100000:0.0:1788918404.937641:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918404.937718:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 000000009a448012 going to sleep for 11 seconds 00000100:00100000:2.0:1788918404.937792:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865597440 00000100:00100000:2.0:1788918404.937798:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865597440 00000100:00100000:2.0:1788918404.937869:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788918404.937878:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006360ca56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+11:5901:x1875816865597440:12345-0@lo:101: 00010000:00010000:2.0:1788918404.937889:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918404.937900:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000851cd8c8/0x2811b8b2b0ac8a73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8a6c expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.937921:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000851cd8c8/0x2811b8b2b0ac8a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8a6c expref: 12 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.937930:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000851cd8c8/0x2811b8b2b0ac8a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8a6c expref: 12 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918404.937939:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000851cd8c8, rc 0) 00000100:00100000:2.0:1788918404.937986:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006360ca56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5901:x1875816865597440:12345-0@lo:101: Request processed in 110us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918404.937993:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788918404.938074:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033068768 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865597440:0@lo:101: 00010000:00010000:1.0:1788918404.938087:0:5901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 00000000c962424c/0x2811b8b2b0ac8a6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a73 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.938095:0:5901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 00000000c962424c/0x2811b8b2b0ac8a6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8a73 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918404.938142:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f7713d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865597568:0@lo:501: 00000100:00100000:1.0:1788918404.938183:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918404.938216:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 000000000559a115 going to sleep for 11 seconds 00000100:00100000:3.0:1788918404.938233:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865597568 00000100:00100000:3.0:1788918404.938238:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865597568 00000100:00100000:3.0:1788918404.938259:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788918404.938265:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c73ce2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5901:x1875816865597568:12345-0@lo:501: 00000100:00100000:3.0:1788918404.938389:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c73ce2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5901:x1875816865597568:12345-0@lo:501: Request processed in 124us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918404.938397:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788918404.938415:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f7713d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865597568:0@lo:501: 00000100:00100000:1.0:1788918404.938442:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f7713d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865597696:0@lo:503: 00000100:00100000:1.0:1788918404.938479:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918404.938489:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 000000000559a115 going to sleep for 11 seconds 00000100:00100000:2.0:1788918404.938494:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865597696 00000100:00100000:2.0:1788918404.938498:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865597696 00000100:00100000:2.0:1788918404.938560:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788918404.938566:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c29bfe7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5901:x1875816865597696:12345-0@lo:503: 00000100:00100000:2.0:1788918404.938640:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c29bfe7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5901:x1875816865597696:12345-0@lo:503: Request processed in 75us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918404.938653:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788918404.938696:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f7713d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865597696:0@lo:503: 00000100:00100000:1.0:1788918404.939405:0:5951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f7713d6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:5951:1875816865597824:0@lo:502: 00000100:00100000:1.0:1788918404.939446:0:5951:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918404.939478:0:5951:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b252d3dc going to sleep for 11 seconds 00000100:00100000:0.0:1788918404.939749:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865597824 00000100:00100000:0.0:1788918404.939755:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865597824 00000100:00100000:0.0:1788918404.939832:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788918404.939840:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032ccb6dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5951:x1875816865597824:12345-0@lo:502: 00000100:00100000:0.0:1788918404.939938:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032ccb6dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5951:x1875816865597824:12345-0@lo:502: Request processed in 99us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918404.939951:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788918404.939993:0:5951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f7713d6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:5951:1875816865597824:0@lo:502: 00000020:01000004:1.0:1788918404.940063:0:5951:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788918404.940083:0:5951:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000009d646ad9) 00000020:00000080:1.0:1788918404.940101:0:5951:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788918404.940639:0:5951:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d32bc5b9 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788918404.940647:0:5951:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d32bc5b9 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788918404.940649:0:5951:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d32bc5b9 4 00010000:00080000:1.0:1788918404.940680:0:5951:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000006c95985@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.149@tcp at head 00010000:00010000:0.0:1788918404.943232:0:5951:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788918404.943458:0:5951:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788918404.943508:0:5951:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788918404.943521:0:5951:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2811b8b2b0ac8a81 00000100:00080000:0.0:1788918404.943529:0:5951:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788918404.943534:0:5951:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000006c95985 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:0.0:1788918404.943568:0:5951:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000398fb2b5 x1875816865597952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788918404.943590:0:5951:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788918404.943776:0:5951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006931e4e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:5951:1875816865598080:0@lo:502: 00000100:00100000:0.0:1788918404.943843:0:5951:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918404.943874:0:5951:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d9e0646 going to sleep for 11 seconds 00000100:00100000:2.0:1788918404.945323:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000398fb2b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1875816865597952:0@lo:38: 00000100:00100000:2.0:1788918404.945393:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918404.945457:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865598080 00000100:00100000:2.0:1788918404.945464:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865598080 00000100:00100000:2.0:1788918404.945504:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788918404.945513:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f6f3fb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5951:x1875816865598080:12345-0@lo:502: 00000100:00100000:2.0:1788918404.945641:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f6f3fb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5951:x1875816865598080:12345-0@lo:502: Request processed in 129us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918404.945649:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788918404.945726:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865597952 00000100:00100000:0.0:1788918404.945731:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865597952 00000100:00100000:0.0:1788918404.945762:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788918404.945767:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005880c81c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3416:x1875816865597952:12345-0@lo:38: 00000100:00100000:0.0:1788918404.945810:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005880c81c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3416:x1875816865597952:12345-0@lo:38: Request processed in 41us (417us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788918404.945816:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788918404.945848:0:5951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006931e4e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:5951:1875816865598080:0@lo:502: 00000040:00080000:0.0:1788918404.945878:0:5951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788918404.945937:0:5901:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788918404.945955:0:5901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788918404.945969:0:5901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 00000000c962424c/0x2811b8b2b0ac8a6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a73 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.945991:0:5901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 00000000c962424c/0x2811b8b2b0ac8a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a73 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788918404.946065:0:5901:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788918404.946068:0:5901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788918404.946069:0:5901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788918404.946070:0:5901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788918404.946071:0:5901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788918404.946073:0:5901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788918404.946073:0:5901:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788918404.946075:0:5901:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788918404.946076:0:5901:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788918404.946077:0:5901:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788918404.946079:0:5901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788918404.946080:0:5901:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788918404.946084:0:5901:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788918404.946087:0:5901:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788918404.946088:0:5901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788918404.946089:0:5901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788918404.946090:0:5901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788918404.946091:0:5901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788918404.946092:0:5901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788918404.946093:0:5901:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788918404.946094:0:5901:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788918404.946095:0:5901:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788918404.946096:0:5901:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788918404.946097:0:5901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788918404.946098:0:5901:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788918404.946113:0:5901:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788918404.946123:0:5901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006931e4e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865598208:0@lo:253: 00000100:00100000:0.0:1788918404.946151:0:5901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918404.946224:0:3416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788918404.946232:0:3416:0:(import.c:65:import_set_state_nolock()) 0000000006c95985 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788918404.946236:0:3416:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788918404.946239:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000398fb2b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1875816865597952:0@lo:38: 00000100:00100000:1.0:1788918404.946308:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865598208 00000100:00100000:1.0:1788918404.946313:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865598208 00000100:00100000:1.0:1788918404.946346:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788918404.946352:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047e5acf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5901:x1875816865598208:12345-0@lo:253: 20000000:01000000:1.0:1788918404.946381:0:5916:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788918404.946393:0:5916:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788918404.947010:0:5901:0:(client.c:2716:ptlrpc_set_wait()) set 000000007cafec41 going to sleep for 11 seconds 20000000:01000000:3.0:1788918404.951394:0:5916:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788918404.951422:0:5916:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788918404.951597:0:5940:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788918404.951602:0:5940:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788918404.951624:0:5940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.951647:0:5940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000022817004/0x2811b8b2b0ac8a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8a50 expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.951654:0:5940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.951689:0:5940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000022817004/0x2811b8b2b0ac8a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8a50 expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918404.951704:0:5940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000022817004/0x2811b8b2b0ac8a57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a50 expref: 12 pid: 5916 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918404.951717:0:5940:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000aa2bad0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5940:1875816865598336:0@lo:104: 00000100:00100000:0.0:1788918404.951777:0:5940:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918404.951819:0:5940:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053446ab8 going to sleep for 11 seconds 00000100:00100000:3.0:1788918404.951903:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865598336 00000100:00100000:3.0:1788918404.951911:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865598336 00000100:00100000:3.0:1788918404.951967:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788918404.951976:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae604b1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:5940:x1875816865598336:12345-0@lo:104: 00010000:00010000:3.0:1788918404.951987:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8a57 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.952059:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788918404.952065:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae604b1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:5940:x1875816865598336:12345-0@lo:104: Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918404.952072:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788918404.952092:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918404.952097:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8a57 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.952104:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000078e270d2 already unused, calling callback (000000000f8d8b69) 10000000:00010000:3.0:1788918404.952107:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8a57 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.952115:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8a57 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918404.952121:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8a57 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918404.952127:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788918404.952150:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a57 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.952157:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918404.952178:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a57 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.952184:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: 0000000078e270d2/0x2811b8b2b0ac8a50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a57 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918404.952213:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918404.952215:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918404.952217:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918404.952269:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000243245b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865598464:0@lo:103: 00000100:00100000:3.0:1788918404.952297:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918404.952459:0:5940:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000aa2bad0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5940:1875816865598336:0@lo:104: 00010000:00010000:0.0:1788918404.952477:0:5940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918404.952530:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047e5acf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5901:x1875816865598208:12345-0@lo:253: Request processed in 6179us (6379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918404.952539:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788918404.952578:0:5901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006931e4e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:5901:1875816865598208:0@lo:253: 10000000:01000000:0.0:1788918404.952587:0:5901:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788918404.952591:0:5901:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788918404.952593:0:5901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788918404.952594:0:5901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788918404.952595:0:5901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788918404.952602:0:5901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788918404.952603:0:5901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788918404.952604:0:5901:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788918404.952606:0:5901:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788918404.952607:0:5901:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788918404.952608:0:5901:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788918404.952610:0:5901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788918404.952611:0:5901:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788918404.952621:0:5901:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788918404.953330:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865598464 00000100:00100000:1.0:1788918404.953336:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865598464 00010000:00010000:1.0:1788918404.953369:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000022817004/0x2811b8b2b0ac8a57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a50 expref: 12 pid: 5916 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918404.953394:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788918404.953401:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000267775ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:3418:x1875816865598464:12345-0@lo:103: 00010000:00010000:1.0:1788918404.953411:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918404.953415:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000022817004/0x2811b8b2b0ac8a57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a50 expref: 12 pid: 5916 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.953425:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000022817004/0x2811b8b2b0ac8a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a50 expref: 12 pid: 5916 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.953438:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000022817004/0x2811b8b2b0ac8a57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a50 expref: 12 pid: 5916 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.953453:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.953461:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788918404.953481:0:5909:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001879811s 00010000:00010000:1.0:1788918404.953485:0:5909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.953491:0:5909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.953498:0:5909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.953503:0:5909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.953508:0:5909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dfd00cbf already unused, calling callback (00000000872d93ee) 00010000:00010000:1.0:1788918404.953511:0:5909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.953519:0:5909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.953533:0:5909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.953544:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918404.953581:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000267775ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+11:3418:x1875816865598464:12345-0@lo:103: Request processed in 181us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918404.953587:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788918404.953615:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000243245b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865598464:0@lo:103: 00010000:00010000:1.0:1788918404.955507:0:5940:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.955530:0:5940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918404.955537:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dfd00cbf/0x2811b8b2b0ac8a88 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788918404.959544:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1788918404.959720:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788918404.959932:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1788918404.960105:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788918404.960840:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1788918404.961001:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788918404.961848:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788918404.961953:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788918404.962739:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1788918404.962885:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788918404.963157:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1788918404.963579:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788918404.966608:0:5901:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788918404.973609:0:5901:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788918404.973867:0:5957:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788918404.975098:0:5901:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788918404.975213:0:5901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788918404.975663:0:5901:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788918404.975670:0:5901:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788918404.975797:0:5901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788918404.978269:0:5957:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788918404.980162:0:5901:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:2.0:1788918404.980239:0:5956:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788918404.980244:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1788918404.980862:0:5901:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788918404.980895:0:5901:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788918404.981181:0:5901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788918404.981450:0:5901:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1788918404.982091:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788918404.982404:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788918404.982584:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788918404.982724:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788918404.982865:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788918404.982977:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788918404.985161:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788918404.985437:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788918404.985576:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788918404.985716:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788918404.985858:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788918404.986005:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000040:00080000:3.0:1788918404.986914:0:5957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788918404.986986:0:5957:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788918404.986990:0:5957:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1788918404.987376:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788918404.987517:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788918404.987659:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788918404.987814:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788918404.988540:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788918404.988710:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788918404.988841:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788918404.988958:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788918404.989131:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788918404.989384:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788918404.989514:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788918404.989620:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788918404.989720:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788918404.989838:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788918404.989945:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788918404.990222:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788918404.990470:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788918404.990584:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788918404.990683:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788918404.990784:0:5901:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788918404.990949:0:5901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788918404.992861:0:5901:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788918404.992890:0:5901:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa86d81c8b988 00100000:10000000:1.0:1788918404.992898:0:5901:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788918404.993228:0:5901:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788918404.993241:0:5901:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.149@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788918404.993283:0:5901:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788918404.993298:0:5901:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788918404.993899:0:5901:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788918404.994089:0:5901:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788918405.591605:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918406.615828:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918407.747417:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918408.727568:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788918408.735412:0:6201:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1788918409.735490:0:6253:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788918409.735681:0:6253:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788918409.757480:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788918410.331293:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788918410.331304:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788918410.331317:0:37:0:(import.c:65:import_set_state_nolock()) 0000000006c95985 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788918410.331329:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000006c95985 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:1.0:1788918410.331350:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ebc01a31 x1875816865598720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788918410.331387:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ebc01a31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1875816865598720:0@lo:38: 00000100:00100000:1.0:1788918410.331456:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918410.331604:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f7713d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865598592:0@lo:400: 00000100:00100000:0.0:1788918410.334572:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918410.334666:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865598592 00000100:00100000:0.0:1788918410.334674:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865598592 00000100:00100000:0.0:1788918410.334718:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788918410.334727:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000815c99f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+11:3419:x1875816865598592:12345-0@lo:400: 00000100:00100000:0.0:1788918410.334792:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000815c99f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+11:3419:x1875816865598592:12345-0@lo:400: Request processed in 67us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918410.334801:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788918410.334852:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f7713d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865598592:0@lo:400: 00000100:00100000:3.0:1788918410.340398:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865598720 00000100:00100000:3.0:1788918410.340411:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865598720 00000100:00100000:3.0:1788918410.340447:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788918410.340454:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b0b1a3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3416:x1875816865598720:12345-0@lo:38: 00010000:00080000:3.0:1788918410.340494:0:5926:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 112 last 0 00000020:00000080:3.0:1788918410.340530:0:5926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2811b8b2b0ac8a8f 00000004:00100000:3.0:1788918410.340564:0:5926:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788918410.340674:0:5926:0:(import.c:65:import_set_state_nolock()) 000000006f353a12 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788918410.340750:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b0b1a3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3416:x1875816865598720:12345-0@lo:38: Request processed in 295us (9294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918410.340766:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788918410.340909:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ebc01a31 x1875816865598720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788918420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788918410.340925:0:3416:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788918410.340932:0:3416:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788918410.340937:0:3416:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788918410.340938:0:3416:0:(import.c:65:import_set_state_nolock()) 0000000006c95985 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788918410.340944:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ebc01a31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1875816865598720:0@lo:38: 00010000:00010000:1.0:1788918410.775356:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918411.798512:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788918412.374203:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788918412.374219:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94fffbe70000 from 3 10000000:01000000:0.0:1788918412.374226:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788918412.374304:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 00000000c740a685/0x2811b8b2b0ac8a96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918412.374320:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 00000000c740a685/0x2811b8b2b0ac8a96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918412.374334:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 00000000c740a685/0x2811b8b2b0ac8a96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918412.374367:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006931e4e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865598848:0@lo:101: 00000100:00100000:0.0:1788918412.374461:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918412.374632:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c006720b going to sleep for 11 seconds 00000100:00100000:3.0:1788918412.376815:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865598848 00000100:00100000:3.0:1788918412.376839:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865598848 00000100:00100000:3.0:1788918412.378076:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788918412.378093:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a90e7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+11:5921:x1875816865598848:12345-0@lo:101: 00010000:00010000:3.0:1788918412.378119:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918412.378153:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e7a71a0a/0x2811b8b2b0ac8a9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8a96 expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918412.378187:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e7a71a0a/0x2811b8b2b0ac8a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8a96 expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918412.378199:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e7a71a0a/0x2811b8b2b0ac8a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8a96 expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918412.378209:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e7a71a0a, rc 0) 00000100:00100000:3.0:1788918412.378335:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a90e7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5921:x1875816865598848:12345-0@lo:101: Request processed in 248us (3875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918412.378343:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788918412.378484:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006931e4e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865598848:0@lo:101: 00010000:00010000:1.0:1788918412.378508:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 00000000c740a685/0x2811b8b2b0ac8a96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a9d expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918412.378518:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 00000000c740a685/0x2811b8b2b0ac8a96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8a9d expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918412.378595:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000476bda30 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865598976:0@lo:256: 00000100:00100000:1.0:1788918412.378648:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918412.380830:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041f5179a going to sleep for 11 seconds 00000100:00100000:0.0:1788918412.382877:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865598976 00000100:00100000:0.0:1788918412.382894:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865598976 00000100:00100000:0.0:1788918412.382958:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788918412.382969:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce03ab20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5921:x1875816865598976:12345-0@lo:256: 20000000:01000000:0.0:1788918412.383002:0:5918:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788918412.383036:0:5918:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788918412.383040:0:5918:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788918412.384446:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce03ab20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5921:x1875816865598976:12345-0@lo:256: Request processed in 1473us (5794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918412.384470:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788918412.384563:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000476bda30 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865598976:0@lo:256: 10000000:01000000:0.0:1788918412.384639:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788918412.384651:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 00000000c740a685/0x2811b8b2b0ac8a96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a9d expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918412.384664:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 00000000c740a685/0x2811b8b2b0ac8a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8a9d expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:1.0:1788918412.708503:0:6355:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788918412.708683:0:6355:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788918412.822248:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788918413.431855:0:6403:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd5610010 20000000:00000080:1.0:1788918413.431880:0:6403:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94fffc8b3800 uarg=0000000000000000 20000000:01000000:1.0:1788918413.431922:0:6403:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788918413.431929:0:6403:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788918413.431934:0:6403:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788918413.431999:0:6403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788918413.432009:0:6403:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788918413.435809:0:6403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788918413.436291:0:6403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788918413.436328:0:6403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788918413.436346:0:6403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788918413.436362:0:6403:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788918413.436382:0:6403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918413.436404:0:6403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a42c841c/0x2811b8b2b0ac8a65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8a5e expref: 11 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918413.436411:0:6403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918413.436455:0:6403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a42c841c/0x2811b8b2b0ac8a65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8a5e expref: 11 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918413.436543:0:6403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a42c841c/0x2811b8b2b0ac8a65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a5e expref: 11 pid: 5917 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918413.436560:0:6403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000020d08a1c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6403:1875816865599104:0@lo:104: 00000100:00100000:1.0:1788918413.436628:0:6403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918413.436675:0:6403:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba37595a going to sleep for 11 seconds 00000100:00100000:2.0:1788918413.436762:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865599104 00000100:00100000:2.0:1788918413.436770:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865599104 00000100:00100000:2.0:1788918413.436827:0:5908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788918413.436835:0:5908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007508655d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+3:6403:x1875816865599104:12345-0@lo:104: 00010000:00010000:2.0:1788918413.436848:0:5908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8a65 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.436917:0:5908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788918413.436922:0:5908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007508655d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+3:6403:x1875816865599104:12345-0@lo:104: Request processed in 89us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918413.436930:0:5908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788918413.436950:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918413.436954:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8a65 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.436961:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004d214361 already unused, calling callback (000000000f8d8b69) 10000000:00010000:2.0:1788918413.436964:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8a65 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.436971:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8a65 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788918413.436977:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8a65 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918413.436982:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788918413.437013:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a65 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437045:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788918413.437063:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a65 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437068:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8a5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a65 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437094:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918413.437096:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918413.437097:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918413.437116:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1538d57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865599232:0@lo:103: 00000100:00100000:2.0:1788918413.437223:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918413.437259:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865599232 00000100:00100000:2.0:1788918413.437263:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865599232 00010000:00010000:2.0:1788918413.437293:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a42c841c/0x2811b8b2b0ac8a65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a5e expref: 12 pid: 5917 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918413.437317:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788918413.437322:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000302edc59 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:3420:x1875816865599232:12345-0@lo:103: 00010000:00010000:2.0:1788918413.437332:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918413.437336:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a42c841c/0x2811b8b2b0ac8a65 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a5e expref: 12 pid: 5917 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437345:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a42c841c/0x2811b8b2b0ac8a65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a5e expref: 12 pid: 5917 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437361:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437368:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437379:0:5909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437385:0:5909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437396:0:5909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437402:0:5909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437407:0:5909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007a98a9bd already unused, calling callback (00000000872d93ee) 00010000:00010000:2.0:1788918413.437410:0:5909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437416:0:5909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437424:0:5909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918413.437433:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918413.437458:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000302edc59 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:3420:x1875816865599232:12345-0@lo:103: Request processed in 137us (235us total) trans 0 rc 0/0 00010000:00010000:1.0:1788918413.437589:0:6403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a42c841c/0x2811b8b2b0ac8a65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a5e expref: 12 pid: 5917 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918413.437609:0:6403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000020d08a1c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6403:1875816865599104:0@lo:104: 00010000:00010000:1.0:1788918413.437625:0:6403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918413.437633:0:6403:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918413.437639:0:6403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918413.437645:0:6403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007a98a9bd/0x2811b8b2b0ac8aa4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918413.438221:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788918413.438259:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1538d57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865599232:0@lo:103: 00010000:00010000:1.0:1788918413.852316:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918414.872237:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918415.449482:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007379e673 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865599360:0@lo:400: 00000100:00100000:3.0:1788918415.449585:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918415.449654:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788918415.449660:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af095ef3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865599488:0@lo:400: 00000100:00100000:3.0:1788918415.450392:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918415.450450:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865599360 00000100:00100000:3.0:1788918415.450461:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865599360 00000100:00100000:3.0:1788918415.450519:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788918415.450529:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005148836 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+11:3417:x1875816865599360:12345-0@lo:400: 00000100:00100000:3.0:1788918415.450589:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005148836 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+11:3417:x1875816865599360:12345-0@lo:400: Request processed in 63us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918415.450597:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788918415.450639:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865599488 00000100:00100000:3.0:1788918415.450643:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865599488 00000100:00100000:3.0:1788918415.450736:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788918415.450743:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea76d0bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865599488:12345-0@lo:400: 00000100:00100000:3.0:1788918415.450778:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea76d0bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865599488:12345-0@lo:400: Request processed in 37us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918415.450785:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788918415.450824:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000af095ef3 x1875816865599488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918415.450840:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af095ef3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865599488:0@lo:400: 00000100:00100000:3.0:1788918415.450852:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007379e673 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865599360:0@lo:400: 00010000:00010000:1.0:1788918415.896230:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918416.918939:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918417.945244:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918418.967680:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918419.990307:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788918420.059262:0:5921:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788918420.059269:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94fffbe70000 from 1 10000000:01000000:0.0:1788918420.059273:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788918420.059317:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918420.059329:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918420.059339:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918420.059360:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000aa2bad0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865599616:0@lo:101: 00000100:00100000:0.0:1788918420.059422:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918420.059509:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set 00000000684c96c7 going to sleep for 11 seconds 00000100:00100000:3.0:1788918420.062110:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865599616 00000100:00100000:3.0:1788918420.062122:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865599616 00000100:00100000:3.0:1788918420.062184:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788918420.062193:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006423714 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+11:5921:x1875816865599616:12345-0@lo:101: 00010000:00010000:3.0:1788918420.062208:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918420.062235:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c88aec71/0x2811b8b2b0ac8ab2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8aab expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918420.062260:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c88aec71/0x2811b8b2b0ac8ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8aab expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918420.062270:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c88aec71/0x2811b8b2b0ac8ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8aab expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918420.062279:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c88aec71, rc 0) 00000100:00100000:3.0:1788918420.062337:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006423714 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5921:x1875816865599616:12345-0@lo:101: Request processed in 146us (2916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918420.062344:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788918420.062442:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000aa2bad0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865599616:0@lo:101: 00010000:00010000:0.0:1788918420.062459:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8aab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8ab2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918420.062478:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 000000004d214361/0x2811b8b2b0ac8aab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8ab2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918420.062543:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000aa2bad0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865599744:0@lo:501: 00000100:00100000:0.0:1788918420.062572:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918420.062607:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set 00000000684c96c7 going to sleep for 11 seconds 00000100:00100000:3.0:1788918420.062831:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865599744 00000100:00100000:3.0:1788918420.062836:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865599744 00000100:00100000:3.0:1788918420.062870:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788918420.062876:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054b36016 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5921:x1875816865599744:12345-0@lo:501: 00000100:00100000:3.0:1788918420.063117:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054b36016 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5921:x1875816865599744:12345-0@lo:501: Request processed in 241us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918420.063124:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788918420.063346:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000aa2bad0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865599744:0@lo:501: 00000100:00100000:1.0:1788918420.063377:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000020d08a1c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865599872:0@lo:503: 00000100:00100000:1.0:1788918420.063415:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918420.063475:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set 000000002108f47d going to sleep for 11 seconds 00000100:00100000:0.0:1788918420.066334:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865599872 00000100:00100000:0.0:1788918420.066348:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865599872 00000100:00100000:0.0:1788918420.066403:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788918420.066412:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2d09cdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5921:x1875816865599872:12345-0@lo:503: 00000100:00100000:0.0:1788918420.066548:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2d09cdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5921:x1875816865599872:12345-0@lo:503: Request processed in 137us (3131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918420.066556:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788918420.069138:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000020d08a1c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865599872:0@lo:503: 00000100:00100000:2.0:1788918420.070700:0:6839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1538d57 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:6839:1875816865600000:0@lo:502: 00000100:00100000:2.0:1788918420.070779:0:6839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918420.070828:0:6839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000523f5b0b going to sleep for 11 seconds 00000100:00100000:3.0:1788918420.070879:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865600000 00000100:00100000:3.0:1788918420.070886:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865600000 00000100:00100000:3.0:1788918420.070937:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788918420.070945:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008546ca3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6839:x1875816865600000:12345-0@lo:502: 00000100:00100000:3.0:1788918420.071094:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008546ca3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6839:x1875816865600000:12345-0@lo:502: Request processed in 150us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918420.071102:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788918420.071240:0:6839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1538d57 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:6839:1875816865600000:0@lo:502: 00000020:01000000:2.0:1788918420.071267:0:6839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918420.071282:0:6839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918420.071286:0:6839:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788918420.071293:0:6839:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94fffbe70000 00000020:00000080:2.0:1788918420.071296:0:6839:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788918420.071345:0:6839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:6839:1875816865600128:0@lo:502: 00000100:00100000:2.0:1788918420.071378:0:6839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918420.071414:0:6839:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b35900 going to sleep for 11 seconds 00000100:00100000:3.0:1788918420.071454:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865600128 00000100:00100000:3.0:1788918420.071458:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865600128 00000100:00100000:3.0:1788918420.071491:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788918420.071497:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6839:x1875816865600128:12345-0@lo:502: 00000100:00100000:3.0:1788918420.071628:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6839:x1875816865600128:12345-0@lo:502: Request processed in 130us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918420.071636:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788918420.074119:0:6839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:6839:1875816865600128:0@lo:502: 00000020:01000000:1.0:1788918420.074155:0:6839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788918420.074163:0:6839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918420.074165:0:6839:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788918420.074170:0:6839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788918420.074341:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788918420.074362:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788918420.074373:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0030a00/0x2811b8b2b0ac8aab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8ab2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918420.074383:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc0030a00/0x2811b8b2b0ac8aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8ab2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918420.566745:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788918420.566873:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865600256:0@lo:400: 00000100:00100000:0.0:1788918420.567082:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918420.567434:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865600256 00000100:00100000:3.0:1788918420.567444:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865600256 00000100:00100000:3.0:1788918420.567619:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788918420.567630:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865600256:12345-0@lo:400: 00010000:00080000:1.0:1788918420.567812:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94ffe8d82680 x1875816865600256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918420.567830:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865600256:0@lo:400: 00000100:00100000:3.0:1788918420.567884:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865600256:12345-0@lo:400: Request processed in 81us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918420.567892:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:3.0:1788918420.928233:0:6903:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788918420.928239:0:6903:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788918420.928241:0:6903:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788918420.928517:0:6903:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94fffcaac000 00000020:01000004:3.0:1788918420.928681:0:6903:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788918420.928694:0:6903:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788918420.928711:0:6903:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff94fffbdd8000) 00000020:00000080:3.0:1788918420.928728:0:6903:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788918420.973330:0:6903:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788918420.973416:0:6903:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1788918421.005360:0:6903:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788918421.005622:0:6903:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788918421.005634:0:6903:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788918421.005648:0:6903:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2811b8b2b0ac8ac0 00000020:01000004:1.0:1788918421.005783:0:6903:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788918421.005808:0:6903:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.149@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788918421.005812:0:6903:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788918421.005818:0:6903:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788918421.005822:0:6903:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788918421.005833:0:6903:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff94fffc9b99c0) 00000020:00000080:1.0:1788918421.005845:0:6903:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1788918421.008793:0:6903:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788918421.009087:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788918421.009095:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788918421.014687:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788918421.014709:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788918421.017473:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788918421.017489:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788918421.021611:0:6903:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788918421.021968:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788918421.021993:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788918421.024324:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788918421.024339:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:3.0:1788918421.026563:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918421.058008:0:6903:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918421.059439:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788918421.059447:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788918421.061711:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788918421.061726:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788918421.062784:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788918421.062795:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788918421.069093:0:6903:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788918421.069300:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788918421.069307:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788918421.069884:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788918421.069891:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788918421.114221:0:6903:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788918421.114432:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788918421.114448:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788918421.115760:0:6903:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788918421.115771:0:6903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788918421.116291:0:6903:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788918421.116322:0:6903:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788918421.116329:0:6903:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.149@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788918421.138371:0:6903:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788918421.138421:0:6903:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.149@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788918421.138425:0:6903:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788918421.138427:0:6903:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788918421.138428:0:6903:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788918421.138429:0:6903:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788918421.138430:0:6903:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788918421.138431:0:6903:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788918421.138432:0:6903:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788918421.138433:0:6903:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788918421.138435:0:6903:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788918421.138436:0:6903:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788918421.138437:0:6903:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788918421.138442:0:6903:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788918421.141626:0:6903:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788918421.141630:0:6903:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788918421.141631:0:6903:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788918421.141633:0:6903:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788918421.141634:0:6903:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788918421.141636:0:6903:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788918421.141637:0:6903:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788918421.141638:0:6903:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788918421.141640:0:6903:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788918421.141641:0:6903:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788918421.141643:0:6903:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788918421.141695:0:6903:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788918421.141720:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865600384:0@lo:253: 00000100:00100000:3.0:1788918421.141803:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918421.144352:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbdc5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918421.145851:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865600384 00000100:00100000:0.0:1788918421.145866:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865600384 00000100:00100000:0.0:1788918421.145980:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788918421.145992:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6903:x1875816865600384:12345-0@lo:253: 20000000:01000000:0.0:1788918421.146078:0:5918:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788918421.146082:0:5918:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788918421.146088:0:5918:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788918421.146091:0:5918:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788918421.146388:0:5918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788918421.146523:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788918421.146537:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788918421.146554:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788918421.146562:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788918421.146575:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788918421.146590:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788918421.147842:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788918421.147875:0:5918:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.149@tcp 20000000:01000000:0.0:1788918421.147878:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.149@tcp (null) (null) (null) 00000040:00080000:0.0:1788918421.147896:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788918421.148144:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788918421.148166:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788918421.148173:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.149@tcp (null) (null) 00000040:00080000:0.0:1788918421.148187:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788918421.148194:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788918421.148236:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788918421.148253:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788918421.148630:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788918421.148644:0:5918:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.149@tcp 20000000:01000000:0.0:1788918421.148645:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.149@tcp (null) (null) (null) 00000040:00080000:0.0:1788918421.148659:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788918421.148665:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788918421.148678:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788918421.148684:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.149@tcp (null) (null) 00000040:00080000:0.0:1788918421.148700:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788918421.148707:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788918421.148721:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788918421.148737:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788918421.148749:0:5918:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788918421.148751:0:5918:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788918421.148754:0:5918:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788918421.148794:0:5918:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788918421.148797:0:5918:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788918421.151848:0:6922:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788918421.151897:0:6922:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788918421.151913:0:6922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788918421.152334:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788918421.152360:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788918421.152376:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788918421.152388:0:5918:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788918421.152390:0:5918:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788918421.152792:0:6923:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788918421.152813:0:6923:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788918421.152827:0:6923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788918421.153285:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788918421.153308:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788918421.153330:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788918421.153342:0:5918:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788918421.153344:0:5918:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788918421.153708:0:6924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788918421.153899:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788918421.153920:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788918421.153934:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:1.0:1788918421.153959:0:5918:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788918421.153977:0:5918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.153996:0:5918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac89e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac89e0 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.154003:0:5918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1481400/0x2811b8b2b0ac8a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac89fc expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.154009:0:5918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1529600/0x2811b8b2b0ac8a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8a6c expref: 12 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.154017:0:5918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.154249:0:5918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1529600/0x2811b8b2b0ac8a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8a6c expref: 12 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.154265:0:5918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1529600/0x2811b8b2b0ac8a73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a6c expref: 12 pid: 5918 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918421.154281:0:5918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc874e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865600512:0@lo:104: 00000100:00100000:1.0:1788918421.154362:0:5918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788918421.154467:0:5918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1481400/0x2811b8b2b0ac8a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac89fc expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.154475:0:5918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1481400/0x2811b8b2b0ac8a03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac89fc expref: 12 pid: 5917 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918421.154484:0:5918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865600640:0@lo:104: 00000100:00100000:1.0:1788918421.154514:0:5918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788918421.158690:0:5918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac89e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac89e0 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.158709:0:5918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac89e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac89e0 expref: 12 pid: 5917 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918421.158723:0:5918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865600768:0@lo:104: 00000100:00100000:1.0:1788918421.158774:0:5918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918421.160634:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865600512 00000100:00100000:0.0:1788918421.160648:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865600512 00000100:00100000:0.0:1788918421.160804:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865600640 00000100:00100000:0.0:1788918421.160808:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865600640 00000100:00100000:0.0:1788918421.160827:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788918421.160837:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+4:5918:x1875816865600512:12345-0@lo:104: 00010000:00010000:0.0:1788918421.160856:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac8a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8a73 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.160949:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788918421.160974:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+4:5918:x1875816865600512:12345-0@lo:104: Request processed in 137us (6612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.160982:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788918421.161002:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788918421.161009:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc874000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:5918:x1875816865600640:12345-0@lo:104: 00010000:00010000:0.0:1788918421.161040:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac89fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8a03 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.161077:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788918421.161082:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc874000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:5918:x1875816865600640:12345-0@lo:104: Request processed in 75us (6568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.161088:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788918421.161169:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788918421.161178:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac8a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8a73 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.161186:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030000 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918421.161190:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac8a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8a73 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.161199:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac8a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8a73 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918421.161236:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac8a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8a73 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918421.161243:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788918421.161284:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac8a6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a73 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.161290:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918421.161317:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac8a6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a73 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.161325:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac8a6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a73 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.161340:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918421.161343:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac89fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8a03 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.161350:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1529c00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918421.161353:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac89fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8a03 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.161367:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac89fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8a03 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918421.161373:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac89fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8a03 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918421.161378:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788918421.161392:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac89fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a03 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.161398:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918421.161412:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac89fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a03 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.161419:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac89fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a03 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.161430:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918421.161432:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918421.161433:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918421.161439:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918421.161447:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788918421.161460:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865600896:0@lo:103: 00000100:00100000:3.0:1788918421.161497:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918421.161539:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865601024:0@lo:103: 00000100:00100000:3.0:1788918421.161563:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918421.161823:0:5918:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd054bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788918421.161845:0:5918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc874e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865600512:0@lo:104: 00000100:00100000:1.0:1788918421.161855:0:5918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865600640:0@lo:104: 00000100:00100000:0.0:1788918421.161906:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865600768 00000100:00100000:0.0:1788918421.161911:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865600768 00000100:00100000:0.0:1788918421.161933:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788918421.161939:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc874700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:5918:x1875816865600768:12345-0@lo:104: 00010000:00010000:0.0:1788918421.161948:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac89e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac89e7 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.161992:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788918421.161997:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc874700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:5918:x1875816865600768:12345-0@lo:104: Request processed in 58us (3223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.162003:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788918421.162063:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865600896 00000100:00100000:0.0:1788918421.162067:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865600896 00010000:00010000:0.0:1788918421.162082:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1529600/0x2811b8b2b0ac8a73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a6c expref: 13 pid: 5918 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918421.162100:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865601024 00000100:00100000:0.0:1788918421.162108:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865601024 00010000:00010000:0.0:1788918421.162119:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1481400/0x2811b8b2b0ac8a03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac89fc expref: 14 pid: 5917 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918421.162131:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788918421.162136:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+14:3419:x1875816865600896:12345-0@lo:103: 00010000:00010000:0.0:1788918421.162145:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918421.162149:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1529600/0x2811b8b2b0ac8a73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a6c expref: 14 pid: 5918 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.162160:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1529600/0x2811b8b2b0ac8a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a6c expref: 14 pid: 5918 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.162173:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1529600/0x2811b8b2b0ac8a73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a6c expref: 14 pid: 5918 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.162186:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918421.162591:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865600896:0@lo:103: 00010000:00010000:3.0:1788918421.162614:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918421.162626:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac89e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac89e7 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.162633:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031000 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918421.162637:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac89e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac89e7 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.162644:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac89e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac89e7 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918421.162650:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac89e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac89e7 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918421.162669:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788918421.162694:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac89e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac89e7 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.162700:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918421.162711:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac89e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac89e7 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.162718:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac89e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac89e7 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.162731:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918421.162732:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918421.162734:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918421.162744:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865601152:0@lo:103: 00000100:00100000:3.0:1788918421.162775:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918421.163106:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+13:3419:x1875816865600896:12345-0@lo:103: Request processed in 967us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.163116:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788918421.163133:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865601152 00000100:00100000:0.0:1788918421.163139:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865601152 00010000:00010000:0.0:1788918421.163154:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac89e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac89e0 expref: 13 pid: 5917 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918421.163172:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788918421.163180:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+13:3417:x1875816865601024:12345-0@lo:103: 00010000:00010000:0.0:1788918421.163188:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918421.163193:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1481400/0x2811b8b2b0ac8a03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac89fc expref: 13 pid: 5917 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163228:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1481400/0x2811b8b2b0ac8a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac89fc expref: 13 pid: 5917 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163241:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1481400/0x2811b8b2b0ac8a03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac89fc expref: 13 pid: 5917 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163251:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918421.163287:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:3417:x1875816865601024:12345-0@lo:103: Request processed in 108us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.163293:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788918421.163306:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788918421.163311:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+11:3418:x1875816865601152:12345-0@lo:103: 00010000:00010000:0.0:1788918421.163319:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918421.163323:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac89e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac89e0 expref: 11 pid: 5917 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163331:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac89e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac89e0 expref: 11 pid: 5917 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163343:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163351:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163364:0:5909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163372:0:5909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163386:0:5909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163394:0:5909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163400:0:5909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1492200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918421.163404:0:5909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163412:0:5909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163421:0:5909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.163430:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918421.163455:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+11:3418:x1875816865601152:12345-0@lo:103: Request processed in 144us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.163461:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788918421.163698:0:5918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac89e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac89e0 expref: 10 pid: 5917 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918421.163709:0:5918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865600768:0@lo:104: 00010000:00010000:1.0:1788918421.163730:0:5918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.163739:0:5918:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.163745:0:5918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.163752:0:5918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8ace lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788918421.163764:0:5918:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788918421.164584:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865601024:0@lo:103: 00000100:00100000:0.0:1788918421.166600:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865601152:0@lo:103: 00000100:00100000:0.0:1788918421.166963:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+9:6903:x1875816865600384:12345-0@lo:253: Request processed in 20972us (25159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.166974:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788918421.167081:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865600384:0@lo:253: 10000000:01000000:1.0:1788918421.167108:0:6903:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788918421.167111:0:6903:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788918421.167113:0:6903:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788918421.167114:0:6903:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788918421.167115:0:6903:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788918421.167116:0:6903:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788918421.167117:0:6903:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788918421.167119:0:6903:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788918421.167121:0:6903:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788918421.167123:0:6903:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788918421.167125:0:6903:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788918421.167138:0:6903:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94fffcaac000 from lustre-OST0000 10000000:01000000:1.0:1788918421.167181:0:6903:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788918421.167184:0:6903:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788918421.167192:0:6903:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94fffbddcd40 local copy 10000000:01000000:1.0:1788918421.167195:0:6903:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788918421.167241:0:6903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.167252:0:6903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.167262:0:6903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918421.167279:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865601280:0@lo:101: 00000100:00100000:1.0:1788918421.167314:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918421.167354:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffc8c0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918421.167420:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865601280 00000100:00100000:2.0:1788918421.167426:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865601280 00000100:00100000:2.0:1788918421.167465:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788918421.167473:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+9:6903:x1875816865601280:12345-0@lo:101: 00010000:00010000:2.0:1788918421.167485:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918421.167499:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8adc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8ad5 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.167529:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8ad5 expref: 10 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.167539:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8ad5 expref: 10 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.167553:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1529800, rc 0) 00000100:00100000:2.0:1788918421.167592:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+10:6903:x1875816865601280:12345-0@lo:101: Request processed in 121us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918421.167598:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788918421.168159:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865601280:0@lo:101: 00010000:00010000:1.0:1788918421.168173:0:6903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2811b8b2b0ac8adc expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.168192:0:6903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2811b8b2b0ac8adc expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918421.168707:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865601408:0@lo:501: 00000100:00100000:1.0:1788918421.168745:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918421.168784:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffc8c0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918421.168838:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865601408 00000100:00100000:0.0:1788918421.168843:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865601408 00000100:00100000:0.0:1788918421.168882:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788918421.168890:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+10:6903:x1875816865601408:12345-0@lo:501: 00000100:00100000:0.0:1788918421.168968:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+10:6903:x1875816865601408:12345-0@lo:501: Request processed in 79us (222us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788918421.168974:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788918421.169178:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865601408:0@lo:501: 10000000:01000000:1.0:1788918421.169190:0:6903:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788918421.169217:0:6903:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788918421.169223:0:6903:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2811b8b2b0ac8adc expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.169232:0:6903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2811b8b2b0ac8adc expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.169239:0:6903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2811b8b2b0ac8adc expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.169262:0:6903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788918421.169285:0:6903:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94fffcaac000 10000000:01000000:1.0:1788918421.169290:0:6903:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788918421.169294:0:6903:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff94fffbddcd40 10000000:01000000:1.0:1788918421.169296:0:6903:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788918421.169299:0:6903:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff94fffbddcd40 from 1 10000000:01000000:1.0:1788918421.169301:0:6903:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788918421.169322:0:6903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493200/0x2811b8b2b0ac8ae3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.169340:0:6903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1493200/0x2811b8b2b0ac8ae3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.169348:0:6903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1493200/0x2811b8b2b0ac8ae3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918421.169361:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865601536:0@lo:101: 00000100:00100000:1.0:1788918421.169389:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918421.169407:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8821cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788918421.169459:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918421.169465:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2811b8b2b0ac8adc expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.169472:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1493600 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:0.0:1788918421.169477:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2811b8b2b0ac8adc expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.169484:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2811b8b2b0ac8adc expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788918421.169492:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2811b8b2b0ac8adc expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918421.169498:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788918421.169516:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2811b8b2b0ac8adc expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.169521:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788918421.169546:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2811b8b2b0ac8adc expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.169554:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8ad5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2811b8b2b0ac8adc expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.169571:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918421.169573:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918421.169580:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918421.169628:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865601536 00000100:00100000:2.0:1788918421.169633:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865601536 00000100:00100000:2.0:1788918421.169667:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788918421.169674:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+10:6903:x1875816865601536:12345-0@lo:101: 00010000:00010000:2.0:1788918421.169683:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918421.169696:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1528600/0x2811b8b2b0ac8aea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8ae3 expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.169712:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1528600/0x2811b8b2b0ac8aea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8ae3 expref: 11 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.169722:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1528600/0x2811b8b2b0ac8aea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8ae3 expref: 11 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.169730:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1528600, rc 0) 00000100:00100000:2.0:1788918421.169759:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+11:6903:x1875816865601536:12345-0@lo:101: Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918421.169765:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788918421.169847:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788918421.169859:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865601664:0@lo:103: 00000100:00100000:1.0:1788918421.169888:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918421.169937:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865601536:0@lo:101: 00010000:00010000:1.0:1788918421.169949:0:6903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1493200/0x2811b8b2b0ac8ae3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8aea expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.169958:0:6903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1493200/0x2811b8b2b0ac8ae3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8aea expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918421.169971:0:6903:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788918421.169988:0:6903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493200/0x2811b8b2b0ac8ae3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8aea expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.169996:0:6903:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1493200/0x2811b8b2b0ac8ae3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8aea expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918421.170004:0:6903:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788918421.170012:0:6903:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788918421.170041:0:6903:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788918421.170043:0:6903:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788918421.170069:0:6903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.170077:0:6903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.170085:0:6903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918421.170098:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865601792:0@lo:101: 00000100:00100000:1.0:1788918421.170125:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918421.170136:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8821cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918421.170249:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865601664 00000100:00100000:0.0:1788918421.170254:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865601664 00000100:00100000:0.0:1788918421.170284:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788918421.170291:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+11:3420:x1875816865601664:12345-0@lo:103: 00010000:00010000:0.0:1788918421.170300:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918421.170310:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8adc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8ad5 expref: 11 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.170322:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918421.170358:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+10:3420:x1875816865601664:12345-0@lo:103: Request processed in 67us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.170364:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788918421.170447:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865601792 00000100:00100000:2.0:1788918421.170451:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865601792 00000100:00100000:2.0:1788918421.170479:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788918421.170486:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+10:6903:x1875816865601792:12345-0@lo:101: 00010000:00010000:2.0:1788918421.170493:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918421.170507:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8af8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8af1 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.170520:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8af1 expref: 11 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.170528:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8af1 expref: 11 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.170534:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1529a00, rc 0) 00000100:00100000:2.0:1788918421.170560:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+11:6903:x1875816865601792:12345-0@lo:101: Request processed in 74us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918421.170564:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788918421.170884:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865601664:0@lo:103: 00000100:00100000:1.0:1788918421.170913:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865601792:0@lo:101: 00010000:00010000:1.0:1788918421.170923:0:6903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8af8 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.170931:0:6903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8af8 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918421.171004:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865601920:0@lo:501: 00000100:00100000:1.0:1788918421.171079:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918421.171104:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8821cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918421.171219:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865601920 00000100:00100000:0.0:1788918421.171224:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865601920 00000100:00100000:0.0:1788918421.171246:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788918421.171252:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+11:6903:x1875816865601920:12345-0@lo:501: 00000100:00100000:0.0:1788918421.171357:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+11:6903:x1875816865601920:12345-0@lo:501: Request processed in 104us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.171363:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788918421.171616:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865601920:0@lo:501: 00000100:00100000:1.0:1788918421.171663:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602048:0@lo:503: 00000100:00100000:1.0:1788918421.171705:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918421.171733:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8821cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918421.171770:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865602048 00000100:00100000:0.0:1788918421.171775:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865602048 00000100:00100000:0.0:1788918421.171806:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788918421.171812:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+11:6903:x1875816865602048:12345-0@lo:503: 00000100:00100000:0.0:1788918421.171897:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+11:6903:x1875816865602048:12345-0@lo:503: Request processed in 85us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.171905:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788918421.171982:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602048:0@lo:503: 00000040:00080000:2.0:1788918421.172284:0:6903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788918421.172943:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602176:0@lo:502: 00000100:00100000:2.0:1788918421.172994:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.173047:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b35540 going to sleep for 11 seconds 00000100:00100000:0.0:1788918421.173215:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865602176 00000100:00100000:0.0:1788918421.173227:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865602176 00000100:00100000:0.0:1788918421.173264:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788918421.173272:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+11:6903:x1875816865602176:12345-0@lo:502: 00000100:00100000:0.0:1788918421.173359:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+11:6903:x1875816865602176:12345-0@lo:502: Request processed in 87us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.173366:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788918421.174411:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602176:0@lo:502: 00000040:00080000:2.0:1788918421.174666:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788918421.174697:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788918421.174712:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788918421.174725:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788918421.174752:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788918421.174766:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788918421.174791:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602304:0@lo:502: 00000100:00100000:2.0:1788918421.174839:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.174880:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b35540 going to sleep for 11 seconds 00000100:00100000:0.0:1788918421.176179:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865602304 00000100:00100000:0.0:1788918421.176188:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865602304 00000100:00100000:0.0:1788918421.176248:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788918421.176257:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+11:6903:x1875816865602304:12345-0@lo:502: 00000100:00100000:0.0:1788918421.176379:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+11:6903:x1875816865602304:12345-0@lo:502: Request processed in 123us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.176386:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788918421.176566:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602304:0@lo:502: 00000040:00080000:2.0:1788918421.176638:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788918421.176649:0:6903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788918421.181006:0:6925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788918421.181043:0:6925:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788918421.181118:0:6925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918421.181121:0:6925:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788918421.181127:0:6925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788918421.181145:0:6925:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff94ffe8db8000) 00000020:00000080:0.0:1788918421.181170:0:6925:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788918421.181177:0:6925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788918421.181277:0:6925:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94fffcaac000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788918421.181286:0:6925:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788918421.181295:0:6925:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2811b8b2b0ac8b06 00010000:00010000:2.0:1788918421.190484:0:6925:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788918421.190954:0:6925:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788918421.194217:0:6925:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788918421.194514:0:6925:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788918421.208790:0:6925:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788918421.208969:0:6925:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788918421.217957:0:6925:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788918421.219433:0:6925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788918421.219446:0:6925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788918421.219459:0:6925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918421.219462:0:6925:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788918421.219467:0:6925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788918421.219471:0:6925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918421.219472:0:6925:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788918421.219476:0:6925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788918421.219478:0:6925:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788918421.219501:0:6925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788918421.219504:0:6925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918421.219505:0:6925:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788918421.219509:0:6925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788918421.221177:0:6903:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788918421.221227:0:6903:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788918421.221257:0:6903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8af8 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.221270:0:6903:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8af8 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918421.221288:0:6903:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94fffcaac000 from 1 10000000:01000000:0.0:1788918421.221291:0:6903:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788918421.221328:0:6903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.221336:0:6903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918421.221347:0:6903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918421.221372:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602432:0@lo:101: 00000100:00100000:0.0:1788918421.221440:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918421.221493:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffcbc6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788918421.222143:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865602432 00000100:00100000:3.0:1788918421.222152:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865602432 00000100:00100000:3.0:1788918421.222775:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788918421.222786:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+11:6903:x1875816865602432:12345-0@lo:101: 00010000:00010000:3.0:1788918421.222802:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918421.222817:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1480a00/0x2811b8b2b0ac8b14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8b0d expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.222841:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1480a00/0x2811b8b2b0ac8b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b0d expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.222852:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1480a00/0x2811b8b2b0ac8b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b0d expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.222861:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1480a00, rc 0) 00000100:00100000:3.0:1788918421.222924:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6903:x1875816865602432:12345-0@lo:101: Request processed in 141us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918421.222931:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788918421.225151:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602432:0@lo:101: 00010000:00010000:2.0:1788918421.225180:0:6903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b14 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.225192:0:6903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8b14 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918421.225317:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602560:0@lo:501: 00000100:00100000:2.0:1788918421.225373:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.225682:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b35240 going to sleep for 11 seconds 00000100:00100000:0.0:1788918421.226061:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865602560 00000100:00100000:0.0:1788918421.226067:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865602560 00000100:00100000:0.0:1788918421.226102:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788918421.226110:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6903:x1875816865602560:12345-0@lo:501: 00000100:00100000:0.0:1788918421.226229:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6903:x1875816865602560:12345-0@lo:501: Request processed in 119us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.226237:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788918421.226381:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602560:0@lo:501: 00000100:00100000:2.0:1788918421.226413:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602688:0@lo:503: 00000100:00100000:2.0:1788918421.226453:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.226469:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b35240 going to sleep for 11 seconds 00000100:00100000:0.0:1788918421.226513:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865602688 00000100:00100000:0.0:1788918421.226516:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865602688 00000100:00100000:0.0:1788918421.226532:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788918421.226537:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6903:x1875816865602688:12345-0@lo:503: 00000100:00100000:0.0:1788918421.226613:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6903:x1875816865602688:12345-0@lo:503: Request processed in 74us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.226627:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788918421.226748:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602688:0@lo:503: 00000040:00080000:2.0:1788918421.226977:0:6903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788918421.227129:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602816:0@lo:502: 00000100:00100000:2.0:1788918421.227163:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.227179:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788918421.227258:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865602816 00000100:00100000:0.0:1788918421.227263:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865602816 00000100:00100000:0.0:1788918421.227279:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788918421.227285:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6903:x1875816865602816:12345-0@lo:502: 00000100:00100000:0.0:1788918421.227358:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6903:x1875816865602816:12345-0@lo:502: Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.227364:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788918421.227493:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602816:0@lo:502: 00000040:00080000:2.0:1788918421.227666:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788918421.227692:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788918421.227712:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602944:0@lo:502: 00000100:00100000:2.0:1788918421.227745:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.227803:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788918421.227874:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865602944 00000100:00100000:0.0:1788918421.227880:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865602944 00000100:00100000:0.0:1788918421.227947:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788918421.227954:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6903:x1875816865602944:12345-0@lo:502: 00000100:00100000:0.0:1788918421.228123:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6903:x1875816865602944:12345-0@lo:502: Request processed in 168us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918421.228129:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788918421.228242:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865602944:0@lo:502: 00000040:00080000:2.0:1788918421.228284:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788918421.228292:0:6903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788918421.230648:0:6929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788918421.230742:0:6929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918421.230745:0:6929:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788918421.230753:0:6929:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94fffcaac000 00000020:00000080:0.0:1788918421.230756:0:6929:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788918421.230770:0:6929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788918421.230774:0:6929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918421.230775:0:6929:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788918421.230778:0:6929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788918421.231592:0:6903:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788918421.231621:0:6903:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788918421.231676:0:6903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b14 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.231688:0:6903:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b14 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918421.231734:0:6903:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788918421.231737:0:6903:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94fffcaac000 10000000:01000000:2.0:1788918421.231740:0:6903:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94fffcaac000 10000000:01000000:2.0:1788918421.231744:0:6903:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788918421.231750:0:6903:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94fffcaac000 from 1 10000000:01000000:2.0:1788918421.231753:0:6903:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788918421.231787:0:6903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.231796:0:6903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.231808:0:6903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918421.231841:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865603072:0@lo:101: 00000100:00100000:2.0:1788918421.231905:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.231947:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fb300 going to sleep for 11 seconds 00000100:00100000:3.0:1788918421.231998:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865603072 00000100:00100000:3.0:1788918421.232006:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865603072 00000100:00100000:3.0:1788918421.232227:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788918421.232238:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:6903:x1875816865603072:12345-0@lo:101: 00010000:00010000:3.0:1788918421.232251:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918421.232265:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1480400/0x2811b8b2b0ac8b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8b1b expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.232289:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1480400/0x2811b8b2b0ac8b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b1b expref: 13 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.232300:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1480400/0x2811b8b2b0ac8b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b1b expref: 13 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918421.232320:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1480400, rc 0) 00000100:00100000:3.0:1788918421.232436:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+13:6903:x1875816865603072:12345-0@lo:101: Request processed in 199us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918421.232443:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788918421.232595:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865603072:0@lo:101: 00010000:00010000:2.0:1788918421.232610:0:6903:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b22 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.232620:0:6903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8b22 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918421.232697:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865603200:0@lo:501: 00000100:00100000:2.0:1788918421.232724:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.232781:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788918421.232851:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865603200 00000100:00100000:1.0:1788918421.232856:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865603200 00000100:00100000:1.0:1788918421.232921:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788918421.232930:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:6903:x1875816865603200:12345-0@lo:501: 00000100:00100000:1.0:1788918421.233262:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:6903:x1875816865603200:12345-0@lo:501: Request processed in 333us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918421.233270:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788918421.233374:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865603200:0@lo:501: 00000100:00100000:2.0:1788918421.233402:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865603328:0@lo:503: 00000100:00100000:2.0:1788918421.233442:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.233499:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788918421.233535:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865603328 00000100:00100000:1.0:1788918421.233540:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865603328 00000100:00100000:1.0:1788918421.233570:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788918421.233578:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:6903:x1875816865603328:12345-0@lo:503: 00000100:00100000:1.0:1788918421.233659:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:6903:x1875816865603328:12345-0@lo:503: Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918421.233672:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788918421.233767:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865603328:0@lo:503: 00000040:00080000:2.0:1788918421.233997:0:6903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788918421.234120:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865603456:0@lo:502: 00000100:00100000:2.0:1788918421.234154:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.234177:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788918421.234355:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865603456 00000100:00100000:1.0:1788918421.234361:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865603456 00000100:00100000:1.0:1788918421.234392:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788918421.234399:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:6903:x1875816865603456:12345-0@lo:502: 00000100:00100000:1.0:1788918421.234476:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:6903:x1875816865603456:12345-0@lo:502: Request processed in 77us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918421.234482:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788918421.234585:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865603456:0@lo:502: 00000040:00080000:2.0:1788918421.234768:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788918421.234800:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788918421.234816:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788918421.234828:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788918421.234841:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788918421.234853:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788918421.234864:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788918421.234876:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788918421.234893:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788918421.234907:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788918421.234918:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788918421.234931:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788918421.234943:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788918421.234969:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788918421.234986:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788918421.234997:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788918421.235009:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788918421.235535:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788918421.235560:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788918421.235575:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788918421.235588:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788918421.235601:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788918421.235614:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788918421.235629:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788918421.235643:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788918421.235656:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788918421.235670:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788918421.235684:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788918421.235717:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865603584:0@lo:502: 00000100:00100000:2.0:1788918421.235768:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.236688:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788918421.238312:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865603584 00000100:00100000:1.0:1788918421.238324:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865603584 00000100:00100000:1.0:1788918421.238391:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788918421.238402:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:6903:x1875816865603584:12345-0@lo:502: 00000100:00100000:1.0:1788918421.238553:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:6903:x1875816865603584:12345-0@lo:502: Request processed in 152us (2783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918421.238561:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788918421.240895:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865603584:0@lo:502: 00000040:00080000:2.0:1788918421.241008:0:6903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788918421.241147:0:6903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788918421.241866:0:6930:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788918421.241881:0:6930:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff94fffc9b8000) 00000020:00000080:1.0:1788918421.241903:0:6930:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788918421.241992:0:6930:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94fffcaac000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788918421.241996:0:6930:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94fffcaac000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788918421.241999:0:6930:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94fffcaac000 3 00010000:00080000:1.0:1788918421.242200:0:6930:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94fffdbe2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.149@tcp at head 00010000:00010000:0.0:1788918421.244947:0:6930:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788918421.245466:0:6930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788918421.245508:0:6930:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788918421.245520:0:6930:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2811b8b2b0ac8b30 00000100:00080000:0.0:1788918421.245530:0:6930:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788918421.245544:0:6930:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94fffdbe2000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:0.0:1788918421.245578:0:6930:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffe8d81500 x1875816865603712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788918421.245608:0:6930:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788918421.245949:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788918421.245963:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865603840:0@lo:400: 00000100:00100000:2.0:1788918421.246069:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.246146:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865603840 00000100:00100000:2.0:1788918421.246153:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865603840 00000100:00100000:2.0:1788918421.246197:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788918421.246217:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865603840:12345-0@lo:400: 00000100:00100000:2.0:1788918421.246269:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865603840:12345-0@lo:400: Request processed in 64us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918421.246276:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788918421.246317:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94ffe8d98380 x1875816865603840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918421.246330:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865603840:0@lo:400: 00000100:00100000:1.0:1788918421.246470:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3416:1875816865603712:0@lo:38: 00000100:00100000:1.0:1788918421.246520:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788918421.246755:0:6930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1788918421.247060:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865603712 00000100:00100000:2.0:1788918421.247065:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865603712 00000100:00100000:2.0:1788918421.247090:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788918421.247095:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3416:x1875816865603712:12345-0@lo:38: 00010000:00080000:2.0:1788918421.247115:0:5925:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 123 last 0 00000020:00000080:2.0:1788918421.247167:0:5925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2811b8b2b0ac8b37 00000004:00100000:2.0:1788918421.247183:0:5925:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788918421.247230:0:5925:0:(import.c:65:import_set_state_nolock()) ffff94ffef801800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788918421.247282:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3416:x1875816865603712:12345-0@lo:38: Request processed in 185us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918421.247289:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788918421.247323:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94ffe8d81500 x1875816865603712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788918431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918421.247344:0:3416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788918421.247351:0:3416:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788918421.247357:0:3416:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788918421.247361:0:3416:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788918421.247363:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94fffdbe2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788918421.247369:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3416:1875816865603712:0@lo:38: 00000020:01000000:2.0:1788918421.247391:0:6903:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788918421.247421:0:6903:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788918421.247436:0:6903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b22 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.247446:0:6903:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b22 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788918421.247518:0:6903:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788918421.247521:0:6903:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788918421.247522:0:6903:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788918421.247523:0:6903:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788918421.247524:0:6903:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788918421.247526:0:6903:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788918421.247527:0:6903:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788918421.247528:0:6903:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788918421.247529:0:6903:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788918421.247531:0:6903:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788918421.247532:0:6903:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788918421.247536:0:6903:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788918421.247539:0:6903:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788918421.247540:0:6903:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788918421.247541:0:6903:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788918421.247543:0:6903:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788918421.247544:0:6903:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788918421.247545:0:6903:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788918421.247550:0:6903:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788918421.247551:0:6903:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788918421.247552:0:6903:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788918421.247553:0:6903:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788918421.247554:0:6903:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788918421.247569:0:6903:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788918421.247579:0:6903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865603968:0@lo:253: 00000100:00100000:2.0:1788918421.247614:0:6903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.247639:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865603968 00000100:00100000:2.0:1788918421.247642:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865603968 00000100:00100000:2.0:1788918421.247675:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788918421.247682:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:6903:x1875816865603968:12345-0@lo:253: 20000000:01000000:2.0:1788918421.247702:0:5918:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788918421.247716:0:5918:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788918421.247833:0:6903:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fb780 going to sleep for 11 seconds 20000000:01000000:2.0:1788918421.252424:0:5918:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788918421.252448:0:5918:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788918421.252748:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:6903:x1875816865603968:12345-0@lo:253: Request processed in 5062us (5127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918421.252761:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788918421.252885:0:6903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:6903:1875816865603968:0@lo:253: 10000000:01000000:3.0:1788918421.252899:0:6903:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788918421.252902:0:6903:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788918421.252904:0:6903:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788918421.252905:0:6903:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788918421.252907:0:6903:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788918421.252908:0:6903:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788918421.252909:0:6903:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788918421.252911:0:6903:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788918421.252912:0:6903:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788918421.252914:0:6903:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788918421.252915:0:6903:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788918421.252917:0:6903:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788918421.252932:0:6903:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788918421.255175:0:5940:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788918421.255184:0:5940:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788918421.255218:0:5940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.255254:0:5940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8a96 expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.255262:0:5940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.255301:0:5940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8a96 expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918421.255317:0:5940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8a9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a96 expref: 12 pid: 5916 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918421.255332:0:5940:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc876a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5940:1875816865604096:0@lo:104: 00000100:00100000:1.0:1788918421.255388:0:5940:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918421.255445:0:5940:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8821b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788918421.255509:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865604096 00000100:00100000:2.0:1788918421.255516:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865604096 00000100:00100000:2.0:1788918421.255570:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788918421.255580:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:5940:x1875816865604096:12345-0@lo:104: 00010000:00010000:2.0:1788918421.255593:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8a9d expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.255651:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788918421.255657:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:5940:x1875816865604096:12345-0@lo:104: Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918421.255664:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788918421.255693:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918421.255700:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8a9d expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.255709:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030800 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:2.0:1788918421.255712:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8a9d expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.255721:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8a9d expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788918421.255728:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8a9d expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918421.255734:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788918421.255762:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8a96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a9d expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.255768:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788918421.255785:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8a96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a9d expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.255792:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8a96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8a9d expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.255809:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918421.255811:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918421.255812:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918421.255825:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865604224:0@lo:103: 00000100:00100000:2.0:1788918421.255855:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918421.255890:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865604224 00000100:00100000:2.0:1788918421.255900:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865604224 00010000:00010000:2.0:1788918421.255916:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8a9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a96 expref: 13 pid: 5916 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918421.255939:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788918421.255945:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:3417:x1875816865604224:12345-0@lo:103: 00010000:00010000:2.0:1788918421.255955:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918421.255960:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8a9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a96 expref: 13 pid: 5916 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.255969:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8a9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a96 expref: 13 pid: 5916 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.255984:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.255992:0:5911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788918421.256004:0:5911:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001879811s 00010000:00010000:2.0:1788918421.256008:0:5911:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.256014:0:5911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.256157:0:5911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.256165:0:5911:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.256180:0:5911:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1492200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918421.256184:0:5911:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.256192:0:5911:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.256199:0:5911:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.256223:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918421.256298:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:3417:x1875816865604224:12345-0@lo:103: Request processed in 353us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918421.256306:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788918421.256380:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8a9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8a96 expref: 12 pid: 5916 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918421.256392:0:5940:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc876a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5940:1875816865604096:0@lo:104: 00010000:00010000:2.0:1788918421.256408:0:5940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.256417:0:5940:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.256423:0:5940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918421.256429:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8b3e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788918421.262622:0:6903:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788918421.262804:0:6903:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788918421.263007:0:6903:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788918421.263906:0:6903:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00000100:00100000:1.0:1788918421.264201:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865604224:0@lo:103: 00080000:10000000:3.0:1788918421.264394:0:6903:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788918421.264607:0:6903:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788918421.267401:0:6903:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788918421.277460:0:6903:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788918421.277470:0:6903:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788918421.277509:0:6903:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788918421.277550:0:6903:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.149@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788918421.277567:0:6903:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788918421.277599:0:6903:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788918421.279426:0:6903:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788918421.279638:0:6903:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:1.0:1788918422.013597:0:6984:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788918422.013969:0:6984:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788918422.038901:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918423.062207:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918424.086193:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918425.111151:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918426.146856:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788918426.710550:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788918426.710557:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94fffbe70000 from 21 10000000:01000000:2.0:1788918426.710561:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788918426.710605:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918426.710617:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918426.710629:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918426.710655:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865604352:0@lo:101: 00000100:00100000:2.0:1788918426.710721:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918426.710775:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc2bcac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788918426.710852:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865604352 00000100:00100000:1.0:1788918426.710859:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865604352 00000100:00100000:1.0:1788918426.710910:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788918426.710920:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5921:x1875816865604352:12345-0@lo:101: 00010000:00010000:1.0:1788918426.710933:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918426.710946:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1492a00/0x2811b8b2b0ac8b4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8b45 expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.710969:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1492a00/0x2811b8b2b0ac8b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b45 expref: 13 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.710992:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1492a00/0x2811b8b2b0ac8b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b45 expref: 13 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.711000:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1492a00, rc 0) 00000100:00100000:1.0:1788918426.711065:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+13:5921:x1875816865604352:12345-0@lo:101: Request processed in 146us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918426.711072:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788918426.711103:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788918426.711114:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865604480:0@lo:400: 00000100:00100000:0.0:1788918426.711140:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865604608:0@lo:400: 00000100:00100000:1.0:1788918426.711143:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918426.711188:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865604480 00000100:00100000:1.0:1788918426.711193:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865604480 00000100:00100000:1.0:1788918426.711221:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788918426.711228:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865604480:12345-0@lo:400: 00000100:00100000:1.0:1788918426.711265:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865604480:12345-0@lo:400: Request processed in 38us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918426.711272:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788918426.711366:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffe8d83800 x1875816865604480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918426.711379:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865604480:0@lo:400: 00000100:00100000:0.0:1788918426.712500:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918426.712673:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865604608 00000100:00100000:3.0:1788918426.712681:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865604608 00000100:00100000:3.0:1788918426.712758:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788918426.712766:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865604608:12345-0@lo:400: 00000100:00100000:3.0:1788918426.712812:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865604608:12345-0@lo:400: Request processed in 46us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918426.712818:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788918426.712853:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788918426.712879:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffe8d80380 x1875816865604608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918426.712891:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865604608:0@lo:400: 00000100:00100000:1.0:1788918426.721820:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865604352:0@lo:101: 00010000:00010000:1.0:1788918426.721850:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b4c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.721863:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8b4c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918426.722836:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865604736:0@lo:501: 00000100:00100000:0.0:1788918426.722900:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918426.722945:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9600 going to sleep for 11 seconds 00000100:00100000:2.0:1788918426.723291:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865604736 00000100:00100000:2.0:1788918426.723298:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865604736 00000100:00100000:2.0:1788918426.723340:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788918426.723348:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:5921:x1875816865604736:12345-0@lo:501: 00000100:00100000:2.0:1788918426.723490:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:5921:x1875816865604736:12345-0@lo:501: Request processed in 142us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918426.723498:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788918426.725092:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865604736:0@lo:501: 00000100:00100000:3.0:1788918426.725141:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865604864:0@lo:503: 00000100:00100000:3.0:1788918426.725212:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918426.725243:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffca15cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918426.726460:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865604864 00000100:00100000:2.0:1788918426.726470:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865604864 00000100:00100000:2.0:1788918426.726521:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788918426.726531:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:5921:x1875816865604864:12345-0@lo:503: 00000100:00100000:2.0:1788918426.726654:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:5921:x1875816865604864:12345-0@lo:503: Request processed in 124us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918426.726662:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788918426.726675:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865604864:0@lo:503: 00000100:00100000:3.0:1788918426.727266:0:7245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:7245:1875816865604992:0@lo:502: 00000100:00100000:3.0:1788918426.727311:0:7245:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918426.727435:0:7245:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffca15a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918426.727470:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865604992 00000100:00100000:0.0:1788918426.727476:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865604992 00000100:00100000:0.0:1788918426.727552:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788918426.727561:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7245:x1875816865604992:12345-0@lo:502: 00000100:00100000:0.0:1788918426.727647:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7245:x1875816865604992:12345-0@lo:502: Request processed in 88us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918426.727654:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788918426.727708:0:7245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:7245:1875816865604992:0@lo:502: 00000100:00100000:3.0:1788918426.727745:0:7245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:7245:1875816865605120:0@lo:502: 00000100:00100000:3.0:1788918426.727777:0:7245:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918426.727866:0:7245:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffca15a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788918426.727894:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865605120 00000100:00100000:1.0:1788918426.727898:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865605120 00000100:00100000:1.0:1788918426.727919:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788918426.727925:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7245:x1875816865605120:12345-0@lo:502: 00000100:00100000:1.0:1788918426.728100:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7245:x1875816865605120:12345-0@lo:502: Request processed in 174us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918426.728107:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788918426.728317:0:7245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:7245:1875816865605120:0@lo:502: 00000040:00080000:3.0:1788918426.728419:0:7245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788918426.728596:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788918426.728619:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788918426.728629:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b4c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918426.728649:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b4c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918426.728659:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788918426.728661:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94fffbe70000 from 4 10000000:01000000:0.0:1788918426.728664:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788918426.728687:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918426.728693:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918426.728701:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918426.728713:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865605248:0@lo:101: 00000100:00100000:0.0:1788918426.728741:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918426.728798:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788918426.728843:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865605248 00000100:00100000:3.0:1788918426.728848:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865605248 00000100:00100000:3.0:1788918426.728918:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788918426.728927:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:5921:x1875816865605248:12345-0@lo:101: 00010000:00010000:3.0:1788918426.728936:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918426.728948:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1481e00/0x2811b8b2b0ac8b5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8b53 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918426.728968:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1481e00/0x2811b8b2b0ac8b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b53 expref: 14 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918426.728979:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1481e00/0x2811b8b2b0ac8b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b53 expref: 14 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918426.728987:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1481e00, rc 0) 00000100:00100000:3.0:1788918426.729042:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865605248:12345-0@lo:101: Request processed in 116us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918426.729049:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788918426.731364:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865605248:0@lo:101: 00010000:00010000:2.0:1788918426.731390:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b5a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918426.731403:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8b5a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918426.731463:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865605376:0@lo:256: 00000100:00100000:2.0:1788918426.731519:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918426.733360:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc2bca540 going to sleep for 11 seconds 00000100:00100000:1.0:1788918426.740253:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865605376 00000100:00100000:1.0:1788918426.740270:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865605376 00000100:00100000:1.0:1788918426.740330:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788918426.740340:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865605376:12345-0@lo:256: 20000000:01000000:1.0:1788918426.740363:0:5917:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788918426.740379:0:5917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788918426.740382:0:5917:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788918426.740522:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865605376:12345-0@lo:256: Request processed in 183us (9002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918426.740530:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788918426.740588:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865605376:0@lo:256: 10000000:01000000:1.0:1788918426.740638:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788918426.740648:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b5a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.740659:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b5a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918426.740669:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788918426.740677:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788918426.740680:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788918426.740709:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.740717:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.740726:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918426.740744:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865605504:0@lo:101: 00000100:00100000:1.0:1788918426.740777:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918426.740799:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865605504 00000100:00100000:1.0:1788918426.740802:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865605504 00000100:00100000:1.0:1788918426.740822:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788918426.740829:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865605504:12345-0@lo:101: 00010000:00010000:1.0:1788918426.740837:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918426.740848:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8b68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8b61 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.740868:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b61 expref: 15 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.740878:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b61 expref: 15 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.740886:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1493400, rc 0) 00000100:00100000:1.0:1788918426.740907:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865605504:12345-0@lo:101: Request processed in 79us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918426.740921:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788918426.740947:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788918426.740957:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865605504:0@lo:101: 00010000:00010000:1.0:1788918426.740969:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b68 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.740978:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8b68 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918426.741085:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865605632:0@lo:501: 00000100:00100000:1.0:1788918426.741107:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918426.741122:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865605632 00000100:00100000:1.0:1788918426.741124:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865605632 00000100:00100000:1.0:1788918426.741141:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788918426.741146:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865605632:12345-0@lo:501: 00000100:00100000:1.0:1788918426.741305:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865605632:12345-0@lo:501: Request processed in 159us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918426.741312:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788918426.741333:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788918426.741343:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865605632:0@lo:501: 00000100:00100000:1.0:1788918426.741366:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865605760:0@lo:503: 00000100:00100000:1.0:1788918426.741399:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918426.741416:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865605760 00000100:00100000:1.0:1788918426.741419:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865605760 00000100:00100000:1.0:1788918426.741438:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788918426.741443:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865605760:12345-0@lo:503: 00000100:00100000:1.0:1788918426.741515:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865605760:12345-0@lo:503: Request processed in 71us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918426.741521:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788918426.741548:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8ee9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788918426.741559:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865605760:0@lo:503: 00000100:00100000:1.0:1788918426.741725:0:7249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:7249:1875816865605888:0@lo:502: 00000100:00100000:1.0:1788918426.741753:0:7249:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918426.741769:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865605888 00000100:00100000:1.0:1788918426.741772:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865605888 00000100:00100000:1.0:1788918426.741790:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788918426.741795:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:7249:x1875816865605888:12345-0@lo:502: 00000100:00100000:1.0:1788918426.741858:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:7249:x1875816865605888:12345-0@lo:502: Request processed in 63us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918426.741865:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788918426.741894:0:7249:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8ee9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788918426.741904:0:7249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:7249:1875816865605888:0@lo:502: 00000020:01000000:1.0:1788918426.741924:0:7249:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788918426.741930:0:7249:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788918426.741936:0:7249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918426.741939:0:7249:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788918426.741943:0:7249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788918426.741947:0:7249:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.149@tcp to nid 0x20000c0a8ca95 (192.168.202.149@tcp) 00000020:01000000:1.0:1788918426.741967:0:7249:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788918426.741969:0:7249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788918426.741983:0:7249:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff94fffc9bcd40) 00000020:00000080:1.0:1788918426.742001:0:7249:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788918426.742005:0:7249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788918426.742102:0:7249:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788918426.743242:0:7249:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788918426.743259:0:7249:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac8b76 00010000:00080000:1.0:1788918426.743302:0:7249:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94fff6869800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.149@tcp at head 00010000:00010000:1.0:1788918426.743530:0:7249:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788918426.756850:0:7249:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788918426.756886:0:7249:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788918426.757308:0:7249:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788918426.757539:0:7249:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788918426.757629:0:7249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788918426.757740:0:7249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788918426.762267:0:7253:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788918426.762276:0:7253:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788918426.765205:0:7249:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788918426.765220:0:7249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788918426.765260:0:7249:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788918426.765286:0:7249:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2811b8b2b0ac8b7d 00000100:00080000:3.0:1788918426.765298:0:7249:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788918426.765309:0:7249:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94fff6869800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788918426.765352:0:7249:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffc70c0380 x1875816865606016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788918426.765373:0:7249:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788918426.765431:0:7249:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918426.765435:0:7249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918426.765437:0:7249:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788918426.765440:0:7249:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788918426.765445:0:7249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918426.765446:0:7249:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788918426.765449:0:7249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788918426.765451:0:7249:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788918426.765482:0:7249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:7249:1875816865606144:0@lo:502: 00000100:00100000:3.0:1788918426.765559:0:7249:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918426.765607:0:7249:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc7040540 going to sleep for 11 seconds 00000100:00100000:0.0:1788918426.765794:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788918426.765804:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865606272:0@lo:400: 00000100:00100000:0.0:1788918426.765835:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918426.765860:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788918426.765866:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865606400:0@lo:400: 00000100:00100000:0.0:1788918426.765888:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918426.765917:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865606272 00000100:00100000:0.0:1788918426.765923:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865606272 00000100:00100000:0.0:1788918426.765955:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865606400 00000100:00100000:0.0:1788918426.765958:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865606400 00000100:00100000:0.0:1788918426.765983:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788918426.765990:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865606272:12345-0@lo:400: 00000100:00100000:0.0:1788918426.766074:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865606272:12345-0@lo:400: Request processed in 84us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918426.766082:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788918426.766098:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788918426.766104:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865606400:12345-0@lo:400: 00000100:00100000:0.0:1788918426.766140:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865606400:12345-0@lo:400: Request processed in 36us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918426.766146:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788918426.766191:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffe8d82d80 x1875816865606272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918426.766205:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865606272:0@lo:400: 00000100:00100000:1.0:1788918426.766323:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865606016:0@lo:8: 00000100:00100000:1.0:1788918426.766359:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918426.766405:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865606144 00000100:00100000:1.0:1788918426.766409:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865606144 00000100:00100000:1.0:1788918426.766433:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788918426.766446:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:7249:x1875816865606144:12345-0@lo:502: 00000100:00100000:1.0:1788918426.766558:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:7249:x1875816865606144:12345-0@lo:502: Request processed in 119us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918426.766566:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788918426.766701:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffe8d80e00 x1875816865606400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918426.766712:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865606400:0@lo:400: 00000100:00100000:3.0:1788918426.766714:0:7249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:7249:1875816865606144:0@lo:502: 00000020:01000000:3.0:1788918426.766734:0:7249:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918426.766739:0:7249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918426.766741:0:7249:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788918426.766744:0:7249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788918426.767314:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788918426.767336:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788918426.767345:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b68 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.767357:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b68 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918426.767366:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788918426.767369:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94fffbddcd40 from 1 10000000:01000000:1.0:1788918426.767372:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788918426.767398:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.767405:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918426.767420:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918426.767436:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865606528:0@lo:101: 00000100:00100000:1.0:1788918426.767478:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918426.767508:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788918426.767572:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865606528 00000100:00100000:3.0:1788918426.767576:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865606528 00000100:00100000:3.0:1788918426.767645:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788918426.767653:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865606528:12345-0@lo:101: 00010000:00010000:3.0:1788918426.767662:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918426.767677:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8b8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8b84 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918426.767697:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b84 expref: 16 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918426.767715:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b84 expref: 16 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918426.767723:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1481a00, rc 0) 00000100:00100000:3.0:1788918426.767758:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865606528:12345-0@lo:101: Request processed in 106us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918426.767765:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788918426.767838:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865606016 00000100:00100000:0.0:1788918426.767843:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865606016 00000100:00100000:0.0:1788918426.767869:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788918426.767875:0:6911:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788918426.767875:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3416:x1875816865606016:12345-0@lo:8: 00000100:00100000:2.0:1788918426.767882:0:6911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1788918426.767895:0:6909:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 129 last 0 00000020:00000080:0.0:1788918426.767917:0:6909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2811b8b2b0ac8b92 00002000:00100000:0.0:1788918426.767949:0:6909:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff94fffcb18800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788918426.767954:0:6909:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788918426.767958:0:6909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788918426.768046:0:6909:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788918426.768257:0:6909:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788918426.768287:0:6909:0:(import.c:65:import_set_state_nolock()) ffff94fffcb1b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788918426.768326:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3416:x1875816865606016:12345-0@lo:8: Request processed in 450us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918426.768337:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788918426.768976:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffc70c0380 x1875816865606016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788918436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918426.768988:0:3416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788918426.768996:0:3416:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788918426.769003:0:3416:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788918426.769008:0:3416:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788918426.769011:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94fff6869800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788918426.769047:0:3416:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788918426.769053:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865606016:0@lo:8: 00000004:00080000:1.0:1788918426.769095:0:7253:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788918426.769207:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865606528:0@lo:101: 00010000:00010000:3.0:1788918426.769226:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b8b expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918426.769237:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8b8b expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918426.769299:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865606656:0@lo:501: 00000100:00100000:3.0:1788918426.769340:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788918426.769361:0:7253:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 129050339843ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788918426.769367:0:7253:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788918426.769378:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc7040000 going to sleep for 11 seconds 00000100:00100000:2.0:1788918426.769435:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865606656 00000100:00100000:2.0:1788918426.769440:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865606656 00000100:00100000:2.0:1788918426.769469:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788918426.769477:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865606656:12345-0@lo:501: 00000100:00100000:2.0:1788918426.769552:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865606656:12345-0@lo:501: Request processed in 74us (211us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788918426.769559:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788918426.769631:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865606656:0@lo:501: 10000000:01000000:3.0:1788918426.769659:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788918426.769664:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b8b expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918426.769672:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8b8b expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788918426.774713:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788918426.774856:0:7255:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788918426.774890:0:7255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7255:1875816865606912:0@lo:7: 00000100:00100000:0.0:1788918426.774970:0:7255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918426.775051:0:7255:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788918426.775070:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865606784:0@lo:13: 00000100:00100000:0.0:1788918426.775099:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918426.776423:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865606912 00000100:00100000:3.0:1788918426.776440:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865606912 00000100:00100000:3.0:1788918426.776536:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788918426.776547:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7255:x1875816865606912:12345-0@lo:7: 00000100:00080000:0.0:1788918426.780240:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788918426.781152:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865606784 00000100:00100000:2.0:1788918426.781265:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865606784 00000100:00100000:2.0:1788918426.781317:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788918426.781327:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3418:x1875816865606784:12345-0@lo:13: 00002000:00000024:2.0:1788918426.781355:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923812352 avail 3692290048 00000100:00100000:2.0:1788918426.781443:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3418:x1875816865606784:12345-0@lo:13: Request processed in 118us (6343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918426.781450:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:3.0:1788918426.782776:0:6912:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788918426.782784:0:6912:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788918426.782858:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7255:x1875816865606912:12345-0@lo:7: Request processed in 6311us (7886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918426.782867:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788918426.782953:0:7255:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffe8d83800 x1875816865606912/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788918442 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918426.782968:0:7255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7255:1875816865606912:0@lo:7: 00000004:00080000:0.0:1788918426.782981:0:7255:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788918426.783052:0:7255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7255:1875816865607040:0@lo:5: 00000100:00100000:0.0:1788918426.783084:0:7255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918426.783117:0:7255:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788918426.783293:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865607040 00000100:00100000:3.0:1788918426.783300:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865607040 00000100:00100000:3.0:1788918426.783339:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788918426.783347:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7255:x1875816865607040:12345-0@lo:5: 00002000:00080000:3.0:1788918426.783372:0:6911:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788918426.783375:0:6911:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:1.0:1788918426.785288:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffe8d82d80 x1875816865606784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918426.785316:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865606784:0@lo:13: 00000001:00080000:0.0:1788918426.787447:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788918426.787462:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788918426.787646:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7255:x1875816865607040:12345-0@lo:5: Request processed in 4296us (4558us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788918426.787657:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788918426.787726:0:7255:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffe8d83800 x1875816865607040/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788918442 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918426.787737:0:7255:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788918426.787742:0:7255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7255:1875816865607040:0@lo:5: 00000004:00080000:0.0:1788918426.787755:0:7255:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788918426.787796:0:7255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7255:1875816865607168:0@lo:700: 00000100:00100000:0.0:1788918426.787835:0:7255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918426.787870:0:7255:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788918426.787914:0:6918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865607168 00000100:00100000:3.0:1788918426.787920:0:6918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865607168 00000100:00100000:3.0:1788918426.787958:0:6918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788918426.787966:0:6918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7255:x1875816865607168:12345-0@lo:700: 00000100:00100000:3.0:1788918426.788003:0:6918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6918:1875816865607296:0@lo:700: 00000100:00100000:3.0:1788918426.788052:0:6918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918426.788068:0:6918:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc7040c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788918426.789184:0:5931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865607296 00000100:00100000:1.0:1788918426.789196:0:5931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865607296 00000100:00100000:1.0:1788918426.789244:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788918426.789252:0:5931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6918:x1875816865607296:12345-0@lo:700: 40000000:02000000:3.0:1788918426.797937:0:5931:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788918426.808909:0:5931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6918:x1875816865607296:12345-0@lo:700: Request processed in 19649us (20846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918426.808929:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788918426.808957:0:6918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffc70c2300 x1875816865607296/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788918442 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918426.808973:0:6918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6918:1875816865607296:0@lo:700: 40000000:02000000:0.0:1788918426.808986:0:6918:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1788918426.835756:0:6918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7255:x1875816865607168:12345-0@lo:700: Request processed in 47778us (47908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918426.835776:0:6918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788918426.836077:0:7255:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffe8d83800 x1875816865607168/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788918442 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918426.836093:0:7255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7255:1875816865607168:0@lo:700: 00000004:02000040:1.0:1788918426.842098:0:7255:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788918426.847387:0:7255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7255:1875816865607424:0@lo:5: 00000100:00100000:1.0:1788918426.847456:0:7255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918426.847512:0:7255:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788918426.847517:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865607424 00000100:00100000:0.0:1788918426.847524:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865607424 00000100:00100000:0.0:1788918426.847587:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788918426.847597:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7255:x1875816865607424:12345-0@lo:5: 00002000:00080000:1.0:1788918426.855846:0:6909:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788918426.855867:0:6909:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788918426.858832:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7255:x1875816865607424:12345-0@lo:5: Request processed in 11228us (11367us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788918426.858851:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788918426.859096:0:7255:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94fffc875f80 x1875816865607424/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788918442 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918426.859115:0:7255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7255:1875816865607424:0@lo:5: 00000004:00080000:0.0:1788918426.859132:0:7255:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:3.0:1788918426.930764:0:7279:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788918427.159166:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788918428.156416:0:7331:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788918428.156818:0:7331:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788918428.184349:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788918429.043736:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788918429.206468:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918430.245234:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788918430.915711:0:7432:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788918430.915914:0:7432:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788918431.264805:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788918431.643653:0:7480:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788918431.643663:0:7480:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788918431.830572:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865607680:0@lo:400: 00000100:00100000:3.0:1788918431.830641:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918431.830763:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788918431.830770:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865607552:0@lo:400: 00000100:00100000:3.0:1788918431.830904:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918431.830939:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865607552 00000100:00100000:3.0:1788918431.830946:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865607552 00000100:00100000:0.0:1788918431.831216:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865607808:0@lo:400: 00000100:00100000:0.0:1788918431.831246:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918431.831274:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788918431.831280:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865607936:0@lo:400: 00000100:00100000:0.0:1788918431.831301:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918431.831330:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865607680 00000100:00100000:0.0:1788918431.831334:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865607680 00000100:00100000:0.0:1788918431.831370:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865607808 00000100:00100000:0.0:1788918431.831372:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865607808 00000100:00100000:0.0:1788918431.831413:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788918431.831419:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865607680:12345-0@lo:400: 00000100:00100000:0.0:1788918431.831468:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865607680:12345-0@lo:400: Request processed in 48us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918431.831475:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788918431.831490:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788918431.831496:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865607808:12345-0@lo:400: 00000100:00100000:0.0:1788918431.831520:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865607808:12345-0@lo:400: Request processed in 25us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918431.831526:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788918431.831545:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865607936 00000100:00100000:0.0:1788918431.831548:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865607936 00000100:00100000:0.0:1788918431.831577:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788918431.831583:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865607936:12345-0@lo:400: 00000100:00100000:0.0:1788918431.831614:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865607936:12345-0@lo:400: Request processed in 32us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918431.831620:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788918431.831636:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788918431.831640:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788918431.831668:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffc70c3100 x1875816865607936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918431.831679:0:3417:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788918431.831697:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865607936:0@lo:400: 00010000:00080000:0.0:1788918431.831710:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffc70c0a80 x1875816865607808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918431.831719:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865607808:0@lo:400: 00010000:00080000:0.0:1788918431.831753:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffc70c0e00 x1875816865607680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918431.831763:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865607680:0@lo:400: 00000100:00100000:2.0:1788918431.832354:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788918431.832365:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865608064:0@lo:13: 00000100:00100000:2.0:1788918431.832401:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918431.832533:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865608064 00000100:00100000:0.0:1788918431.832538:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865608064 00000100:00100000:0.0:1788918431.832570:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788918431.832578:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865608064:12345-0@lo:13: 00002000:00000024:0.0:1788918431.832598:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918431.832636:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865608064:12345-0@lo:13: Request processed in 59us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918431.832643:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788918431.832668:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffe8d81180 x1875816865608064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918431.832683:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865608064:0@lo:13: 00000100:00100000:3.0:1788918431.832970:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788918431.832979:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3420:x1875816865607552:12345-0@lo:400: 00000100:00100000:3.0:1788918431.833038:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3420:x1875816865607552:12345-0@lo:400: Request processed in 61us (2134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918431.833045:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788918431.833164:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865607552:0@lo:400: 00010000:00010000:2.0:1788918432.278330:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918433.310163:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918434.326324:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918435.354256:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918436.374468:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918436.950323:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865608448:0@lo:400: 00000100:00100000:0.0:1788918436.950338:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865608320:0@lo:400: 00000100:00100000:3.0:1788918436.950395:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865608576:0@lo:400: 00000100:00100000:2.0:1788918436.950449:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865608192:0@lo:13: 00000100:00100000:1.0:1788918436.954414:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918436.954558:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865608448 00000100:00100000:1.0:1788918436.954569:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865608448 00000100:00100000:1.0:1788918436.954633:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788918436.954645:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865608448:12345-0@lo:400: 00000100:00100000:1.0:1788918436.954730:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865608448:12345-0@lo:400: Request processed in 88us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918436.954737:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788918436.954808:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94fffc875180 x1875816865608448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918436.954827:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865608448:0@lo:400: 00000100:00100000:1.0:1788918436.960077:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918436.960335:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865608320 00000100:00100000:0.0:1788918436.960349:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865608320 00000100:00100000:0.0:1788918436.960416:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788918436.960428:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3417:x1875816865608320:12345-0@lo:400: 00000100:00100000:0.0:1788918436.960572:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3417:x1875816865608320:12345-0@lo:400: Request processed in 145us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918436.960581:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788918436.960663:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865608320:0@lo:400: 00000100:00100000:3.0:1788918436.961742:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918436.961838:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865608576 00000100:00100000:1.0:1788918436.961847:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865608576 00000100:00100000:1.0:1788918436.961922:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788918436.961933:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865608576:12345-0@lo:400: 00000100:00100000:1.0:1788918436.961985:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865608576:12345-0@lo:400: Request processed in 55us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918436.961992:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788918436.962111:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788918436.962241:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94fffc877480 x1875816865608576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918436.962257:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865608576:0@lo:400: 00000100:00100000:2.0:1788918436.972392:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918436.972460:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865608704:0@lo:400: 00000100:00100000:2.0:1788918436.972495:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918436.972642:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865608192 00000100:00100000:0.0:1788918436.972653:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865608192 00000100:00100000:0.0:1788918436.972750:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788918436.972762:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865608192:12345-0@lo:13: 00002000:00000024:0.0:1788918436.972801:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918436.972854:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865608192:12345-0@lo:13: Request processed in 95us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918436.972862:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788918436.972910:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffe8d81180 x1875816865608192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918436.972933:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865608192:0@lo:13: 00000100:00080000:1.0:1788918436.973017:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918436.973385:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865608704 00000100:00100000:3.0:1788918436.973391:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865608704 00000100:00100000:3.0:1788918436.973432:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788918436.973440:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865608704:12345-0@lo:400: 00000100:00100000:3.0:1788918436.973498:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865608704:12345-0@lo:400: Request processed in 59us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918436.973506:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788918436.973590:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94fffc876300 x1875816865608704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918436.973602:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865608704:0@lo:400: 00010000:00010000:0.0:1788918437.398320:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918438.424503:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918439.446723:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918440.473284:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788918441.470903:0:7979:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788918441.470908:0:7979:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788918441.470909:0:7979:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788918441.471205:0:7979:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94ffef803800 00000020:01000004:2.0:1788918441.471221:0:7979:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788918441.471233:0:7979:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788918441.471254:0:7979:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff94fffca399c0) 00000020:00000080:2.0:1788918441.471270:0:7979:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1788918441.495566:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788918441.502141:0:7979:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788918441.502189:0:7979:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1788918441.522989:0:7979:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788918441.523728:0:7979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788918441.523740:0:7979:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788918441.523750:0:7979:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2811b8b2b0ac8ba0 00000020:01000004:0.0:1788918441.523757:0:7979:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788918441.523778:0:7979:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.149@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788918441.523781:0:7979:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788918441.523786:0:7979:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788918441.523814:0:7979:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788918441.523817:0:7979:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.149@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788918441.536362:0:7979:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788918441.536403:0:7979:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.149@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788918441.536409:0:7979:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788918441.536411:0:7979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788918441.536412:0:7979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788918441.536413:0:7979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788918441.536414:0:7979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788918441.536415:0:7979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788918441.536417:0:7979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788918441.536418:0:7979:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788918441.536419:0:7979:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788918441.536421:0:7979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788918441.536422:0:7979:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788918441.536426:0:7979:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788918441.536428:0:7979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788918441.536429:0:7979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788918441.536430:0:7979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788918441.536431:0:7979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788918441.536432:0:7979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788918441.536433:0:7979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788918441.536434:0:7979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788918441.536435:0:7979:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788918441.536436:0:7979:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788918441.536437:0:7979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788918441.536438:0:7979:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788918441.536473:0:7979:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788918441.536493:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865608832:0@lo:253: 00000100:00100000:0.0:1788918441.536567:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918441.536631:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6b5bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788918441.536706:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865608832 00000100:00100000:3.0:1788918441.536714:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865608832 00000100:00100000:3.0:1788918441.536767:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788918441.536776:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:7979:x1875816865608832:12345-0@lo:253: 20000000:01000000:3.0:1788918441.536804:0:5918:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788918441.536808:0:5918:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788918441.536813:0:5918:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788918441.536816:0:5918:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788918441.537248:0:5918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788918441.537375:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788918441.537390:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788918441.537406:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788918441.537413:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788918441.537426:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788918441.537440:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788918441.537524:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788918441.537538:0:5918:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.149@tcp 20000000:01000000:3.0:1788918441.537540:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.149@tcp (null) (null) (null) 00000040:00080000:3.0:1788918441.537556:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788918441.537561:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788918441.537575:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788918441.537580:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.149@tcp (null) (null) 00000040:00080000:3.0:1788918441.537593:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788918441.537599:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788918441.537611:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788918441.537653:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788918441.538768:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788918441.538785:0:5918:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.149@tcp 20000000:01000000:3.0:1788918441.538787:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.149@tcp (null) (null) (null) 00000040:00080000:3.0:1788918441.538800:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788918441.538813:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788918441.538931:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788918441.538938:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.149@tcp (null) (null) 00000040:00080000:3.0:1788918441.538952:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788918441.538957:0:5918:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788918441.538967:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788918441.538978:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788918441.538990:0:5918:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788918441.539118:0:5918:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788918441.539123:0:5918:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788918441.539166:0:5918:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788918441.539169:0:5918:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788918441.541728:0:7985:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788918441.541768:0:7985:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788918441.541786:0:7985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788918441.542216:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788918441.542242:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788918441.542279:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788918441.542292:0:5918:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788918441.542295:0:5918:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788918441.542731:0:7986:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788918441.542757:0:7986:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788918441.542774:0:7986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788918441.543347:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788918441.543367:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788918441.543381:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788918441.543391:0:5918:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788918441.543393:0:5918:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788918441.544812:0:7987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788918441.546151:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788918441.546191:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788918441.546207:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788918441.546220:0:5918:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788918441.546222:0:5918:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788918441.546651:0:7988:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788918441.546682:0:7988:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788918441.546695:0:7988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788918441.546788:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788918441.546808:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788918441.546930:0:5918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1788918441.546950:0:5918:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788918441.546968:0:5918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.546985:0:5918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8af1 expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.546993:0:5918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1480400/0x2811b8b2b0ac8b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b1b expref: 16 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.547114:0:5918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1492a00/0x2811b8b2b0ac8b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b45 expref: 16 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.547121:0:5918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b61 expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.547128:0:5918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b84 expref: 16 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.547136:0:5918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.547174:0:5918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8b84 expref: 16 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.547188:0:5918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8b8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b84 expref: 16 pid: 5918 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918441.547211:0:5918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865608960:0@lo:104: 00000100:00100000:0.0:1788918441.547335:0:5918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788918441.547421:0:5918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8b61 expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.547429:0:5918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8b68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b61 expref: 16 pid: 5917 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918441.547438:0:5918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d83100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865609088:0@lo:104: 00010000:00010000:0.0:1788918441.547463:0:5918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1492a00/0x2811b8b2b0ac8b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8b45 expref: 16 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.547470:0:5918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1492a00/0x2811b8b2b0ac8b4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b45 expref: 16 pid: 5916 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918441.547477:0:5918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865609216:0@lo:104: 00010000:00010000:0.0:1788918441.547500:0:5918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1480400/0x2811b8b2b0ac8b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8b1b expref: 16 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.547508:0:5918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1480400/0x2811b8b2b0ac8b22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b1b expref: 16 pid: 5916 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918441.547516:0:5918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d83800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865609344:0@lo:104: 00010000:00010000:0.0:1788918441.547553:0:5918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8af1 expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.547561:0:5918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8af1 expref: 16 pid: 5917 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918441.547654:0:5918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865609472:0@lo:104: 00000100:00100000:0.0:1788918441.547674:0:5918:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6b5b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788918441.547771:0:5908:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788918441.547793:0:5908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918441.547820:0:5908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918441.547940:0:5908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918441.547949:0:5908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918441.547958:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865608960 00000100:00100000:1.0:1788918441.547964:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865608960 00000100:00100000:2.0:1788918441.548063:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865609088 00000100:00100000:2.0:1788918441.548068:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865609088 00000100:00100000:2.0:1788918441.548085:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865609216 00000100:00100000:2.0:1788918441.548088:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865609216 00000100:00100000:2.0:1788918441.548097:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865609344 00000100:00100000:2.0:1788918441.548099:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865609344 00000100:00100000:2.0:1788918441.548106:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865609472 00000100:00100000:2.0:1788918441.548108:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865609472 00000100:00100000:2.0:1788918441.548120:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788918441.548129:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd81b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+7:5918:x1875816865608960:12345-0@lo:104: 00010000:00010000:2.0:1788918441.548141:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8b8b expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.548203:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788918441.548209:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd81b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+7:5918:x1875816865608960:12345-0@lo:104: Request processed in 82us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918441.548220:0:5918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865608960:0@lo:104: 00010000:00010000:3.0:1788918441.548275:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918441.548282:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8b8b expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.548289:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1493600 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918441.548293:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8b8b expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.548301:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8b8b expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918441.548319:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8b8b expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918441.548326:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788918441.548359:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b8b expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.548366:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918441.548385:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b8b expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.548392:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8b84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b8b expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.548403:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918441.548405:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918441.548407:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918441.548417:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865609600:0@lo:103: 00000100:00100000:3.0:1788918441.548457:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918441.548495:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865609600 00000100:00100000:0.0:1788918441.548500:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865609600 00010000:00010000:0.0:1788918441.548517:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8b8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b84 expref: 17 pid: 5918 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918441.548548:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788918441.548555:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:3417:x1875816865609600:12345-0@lo:103: 00010000:00010000:0.0:1788918441.548565:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918441.548569:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8b8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b84 expref: 17 pid: 5918 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.548588:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b84 expref: 17 pid: 5918 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.548601:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1481a00/0x2811b8b2b0ac8b8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b84 expref: 17 pid: 5918 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.548613:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918441.548638:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3417:x1875816865609600:12345-0@lo:103: Request processed in 84us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918441.548654:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788918441.549486:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865609600:0@lo:103: 00000100:00100000:2.0:1788918441.550581:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788918441.550623:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788918441.550633:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc875180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+6:5918:x1875816865609088:12345-0@lo:104: 00010000:00010000:2.0:1788918441.550647:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8b68 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918441.550750:0:5918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d83100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865609088:0@lo:104: 00010000:00010000:2.0:1788918441.550756:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788918441.550762:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc875180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+6:5918:x1875816865609088:12345-0@lo:104: Request processed in 132us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918441.550768:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788918441.550783:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788918441.550789:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+5:5918:x1875816865609216:12345-0@lo:104: 00010000:00010000:2.0:1788918441.550797:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8b4c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918441.550951:0:5918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865609216:0@lo:104: 00010000:00010000:3.0:1788918441.554360:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788918441.554375:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8b68 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554387:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1493e00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918441.554392:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8b68 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554418:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8b68 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918441.554423:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8b68 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918441.554435:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788918441.554484:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b68 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554490:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918441.554522:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b68 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554530:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8b61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b68 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554545:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788918441.554545:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788918441.554549:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8b4c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554554:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1528e00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918441.554557:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8b4c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554563:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8b4c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918441.554569:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8b4c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918441.554569:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865609728:0@lo:103: 10000000:01000000:3.0:1788918441.554577:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788918441.554597:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b4c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554602:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918441.554616:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b4c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554622:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1528e00/0x2811b8b2b0ac8b45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b4c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918441.554628:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788918441.554631:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918441.554633:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918441.554635:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918441.554644:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865609856:0@lo:103: 00000100:00100000:3.0:1788918441.554671:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918441.554702:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865609728 00000100:00100000:3.0:1788918441.554709:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865609728 00010000:00010000:3.0:1788918441.554734:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8b68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b61 expref: 16 pid: 5917 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918441.554763:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865609856 00000100:00100000:3.0:1788918441.554767:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865609856 00010000:00010000:3.0:1788918441.554779:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1492a00/0x2811b8b2b0ac8b4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b45 expref: 17 pid: 5916 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918441.554792:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788918441.554800:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:3417:x1875816865609728:12345-0@lo:103: 00000100:00100000:0.0:1788918441.554804:0:5909:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1788918441.554810:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788918441.554811:0:5909:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788918441.554820:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8b68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b61 expref: 17 pid: 5917 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554831:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b61 expref: 17 pid: 5917 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554846:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8b68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b61 expref: 17 pid: 5917 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554859:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918441.554895:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3417:x1875816865609728:12345-0@lo:103: Request processed in 95us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918441.554902:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788918441.554919:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788918441.554925:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:3419:x1875816865609856:12345-0@lo:103: 00010000:00010000:3.0:1788918441.554932:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918441.554937:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1492a00/0x2811b8b2b0ac8b4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b45 expref: 15 pid: 5916 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554945:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1492a00/0x2811b8b2b0ac8b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b45 expref: 15 pid: 5916 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554955:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1492a00/0x2811b8b2b0ac8b4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b45 expref: 15 pid: 5916 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.554963:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918441.554985:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:3419:x1875816865609856:12345-0@lo:103: Request processed in 61us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918441.554990:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788918441.555048:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865609856:0@lo:103: 00000100:00100000:3.0:1788918441.555081:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865609728:0@lo:103: 00010000:00010000:2.0:1788918441.555298:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788918441.555307:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+5:5918:x1875816865609216:12345-0@lo:104: Request processed in 4517us (7484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918441.555316:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788918441.555334:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788918441.555341:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+4:5918:x1875816865609344:12345-0@lo:104: 00010000:00010000:2.0:1788918441.555351:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8b22 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.555396:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788918441.555401:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+4:5918:x1875816865609344:12345-0@lo:104: Request processed in 62us (7462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918441.555406:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788918441.555409:0:5918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d83800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865609344:0@lo:104: 00000100:00100000:2.0:1788918441.555418:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788918441.555449:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918441.555456:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8b22 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.555463:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1528c00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918441.555466:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8b22 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.555473:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8b22 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918441.555489:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8b22 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918441.555495:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788918441.555528:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc876300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:5918:x1875816865609472:12345-0@lo:104: 00010000:00010000:3.0:1788918441.555550:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918441.555553:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b22 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.555559:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788918441.555577:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8af8 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.555578:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b22 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.555585:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8b1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b22 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.555595:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918441.555597:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918441.555599:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918441.555604:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788918441.555612:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865609984:0@lo:103: 00010000:00010000:2.0:1788918441.555618:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788918441.555622:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc876300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:5918:x1875816865609472:12345-0@lo:104: Request processed in 199us (7672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918441.555628:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788918441.555638:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788918441.555642:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918441.555646:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8af8 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.555653:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1492000 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:2.0:1788918441.555656:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8af8 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.555663:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8af8 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788918441.555669:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8af8 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918441.555674:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788918441.555677:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865609984 00000100:00100000:1.0:1788918441.555680:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865609984 00010000:00010000:1.0:1788918441.555694:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1480400/0x2811b8b2b0ac8b22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b1b expref: 14 pid: 5916 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918441.555714:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788918441.555720:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:3419:x1875816865609984:12345-0@lo:103: 00010000:00010000:1.0:1788918441.555727:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918441.555731:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1480400/0x2811b8b2b0ac8b22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b1b expref: 14 pid: 5916 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.555745:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1480400/0x2811b8b2b0ac8b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b1b expref: 14 pid: 5916 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.555755:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1480400/0x2811b8b2b0ac8b22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b1b expref: 14 pid: 5916 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.555764:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918441.555799:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:3419:x1875816865609984:12345-0@lo:103: Request processed in 79us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918441.555804:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788918441.556138:0:5918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5918:1875816865609472:0@lo:104: 00010000:00010000:0.0:1788918441.556162:0:5918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918441.557373:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865609984:0@lo:103: 00010000:00010000:2.0:1788918441.559730:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8af8 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.559743:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788918441.559780:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865610112:0@lo:103: 00000100:00100000:3.0:1788918441.559825:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788918441.559888:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8af8 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.559898:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8af8 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.559935:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918441.559937:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918441.559939:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918441.559946:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865610112 00000100:00100000:0.0:1788918441.559952:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865610112 00010000:00010000:0.0:1788918441.559979:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8af1 expref: 13 pid: 5917 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918441.560047:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788918441.560057:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+13:3417:x1875816865610112:12345-0@lo:103: 00010000:00010000:0.0:1788918441.560069:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918441.560074:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8af1 expref: 13 pid: 5917 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.560084:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8af1 expref: 13 pid: 5917 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.560096:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8af8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8af1 expref: 13 pid: 5917 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.560110:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.560118:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.560138:0:5909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.560146:0:5909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.560152:0:5909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.560159:0:5909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.560164:0:5909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918441.560168:0:5909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.560176:0:5909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.560200:0:5909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.560210:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788918441.560237:0:5918:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.560246:0:5918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.560253:0:5918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc0031400/0x2811b8b2b0ac8ba7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918441.560257:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:3417:x1875816865610112:12345-0@lo:103: Request processed in 202us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918441.560263:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 20000000:01000000:2.0:1788918441.560274:0:5918:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788918441.560497:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865610112:0@lo:103: 00000100:00100000:0.0:1788918441.562103:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865608832:0@lo:253: 10000000:01000000:0.0:1788918441.562117:0:7979:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788918441.562121:0:7979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788918441.562129:0:7979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788918441.562130:0:7979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788918441.562131:0:7979:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788918441.562132:0:7979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788918441.562133:0:7979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788918441.562135:0:7979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788918441.562136:0:7979:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788918441.562138:0:7979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788918441.562139:0:7979:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788918441.562155:0:7979:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94ffef803800 from lustre-OST0001 10000000:01000000:0.0:1788918441.562177:0:7979:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788918441.562179:0:7979:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788918441.562185:0:7979:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94fffbddcd40 local copy 10000000:01000000:0.0:1788918441.562188:0:7979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788918441.562208:0:7979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.562214:0:7979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.562221:0:7979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918441.562305:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+11:7979:x1875816865608832:12345-0@lo:253: Request processed in 25529us (25737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918441.562316:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788918441.562383:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865610240:0@lo:101: 00000100:00100000:0.0:1788918441.562414:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918441.562444:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6b5b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788918441.562503:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865610240 00000100:00100000:1.0:1788918441.562508:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865610240 00000100:00100000:1.0:1788918441.562536:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788918441.562544:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+11:7979:x1875816865610240:12345-0@lo:101: 00010000:00010000:1.0:1788918441.562556:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918441.562569:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1493600/0x2811b8b2b0ac8bb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8bae expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.562587:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1493600/0x2811b8b2b0ac8bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8bae expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.562596:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1493600/0x2811b8b2b0ac8bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8bae expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.562605:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1493600, rc 0) 00000100:00100000:1.0:1788918441.562634:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865610240:12345-0@lo:101: Request processed in 91us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918441.562640:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788918441.562713:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865610240:0@lo:101: 00010000:00010000:0.0:1788918441.563132:0:7979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2811b8b2b0ac8bb5 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.563142:0:7979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2811b8b2b0ac8bb5 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918441.563299:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865610368:0@lo:501: 00000100:00100000:0.0:1788918441.563329:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918441.563412:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6b5b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788918441.563444:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865610368 00000100:00100000:1.0:1788918441.563450:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865610368 00000100:00100000:1.0:1788918441.563509:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788918441.563516:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865610368:12345-0@lo:501: 00000100:00100000:1.0:1788918441.563584:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865610368:12345-0@lo:501: Request processed in 69us (254us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788918441.563592:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788918441.563658:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865610368:0@lo:501: 10000000:01000000:2.0:1788918441.563671:0:7979:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788918441.563689:0:7979:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788918441.563694:0:7979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2811b8b2b0ac8bb5 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.563702:0:7979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2811b8b2b0ac8bb5 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.563709:0:7979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2811b8b2b0ac8bb5 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.563738:0:7979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788918441.563758:0:7979:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94ffef803800 10000000:01000000:2.0:1788918441.563763:0:7979:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788918441.563768:0:7979:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788918441.563770:0:7979:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788918441.563775:0:7979:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788918441.563777:0:7979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788918441.563793:0:7979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.563800:0:7979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.563808:0:7979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918441.563819:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865610496:0@lo:101: 00000100:00100000:2.0:1788918441.563857:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788918441.563991:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918441.563998:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2811b8b2b0ac8bb5 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.564005:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031000 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918441.564008:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2811b8b2b0ac8bb5 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.564016:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2811b8b2b0ac8bb5 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918441.564046:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2811b8b2b0ac8bb5 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918441.564052:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788918441.564056:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd80f80c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788918441.564068:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2811b8b2b0ac8bb5 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.564074:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918441.564098:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2811b8b2b0ac8bb5 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.564118:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac8bae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2811b8b2b0ac8bb5 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.564130:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918441.564132:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918441.564133:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918441.564144:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865610624:0@lo:103: 00000100:00100000:2.0:1788918441.564170:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918441.564232:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865610624 00000100:00100000:3.0:1788918441.564237:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865610624 00000100:00100000:3.0:1788918441.564276:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788918441.564284:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:3418:x1875816865610624:12345-0@lo:103: 00010000:00010000:3.0:1788918441.564294:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918441.564304:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1493600/0x2811b8b2b0ac8bb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8bae expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.564317:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918441.564323:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865610496 00000100:00100000:0.0:1788918441.564327:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865610496 00000100:00100000:0.0:1788918441.564347:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788918441.564353:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865610496:12345-0@lo:101: 00000100:00100000:3.0:1788918441.564354:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:3418:x1875816865610624:12345-0@lo:103: Request processed in 72us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918441.564360:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788918441.564360:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918441.564370:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc0030000/0x2811b8b2b0ac8bc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8bbc expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.564384:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc0030000/0x2811b8b2b0ac8bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8bbc expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.564393:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc0030000/0x2811b8b2b0ac8bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8bbc expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.564400:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0030000, rc 0) 00000100:00100000:2.0:1788918441.564459:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865610624:0@lo:103: 00000100:00100000:0.0:1788918441.564499:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865610496:12345-0@lo:101: Request processed in 146us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918441.564505:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788918441.564763:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865610496:0@lo:101: 00010000:00010000:3.0:1788918441.564772:0:7979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8bc3 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.564777:0:7979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8bc3 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918441.564822:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865610752:0@lo:501: 00000100:00100000:3.0:1788918441.564845:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918441.564882:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbd5a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918441.564887:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865610752 00000100:00100000:0.0:1788918441.564891:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865610752 00000100:00100000:0.0:1788918441.564920:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788918441.564926:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865610752:12345-0@lo:501: 00000100:00100000:0.0:1788918441.565164:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865610752:12345-0@lo:501: Request processed in 237us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918441.565180:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788918441.565298:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865610752:0@lo:501: 00000100:00100000:3.0:1788918441.565335:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865610880:0@lo:503: 00000100:00100000:3.0:1788918441.565381:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918441.565401:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbd5a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918441.565415:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865610880 00000100:00100000:1.0:1788918441.565419:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865610880 00000100:00100000:1.0:1788918441.565480:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788918441.565487:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865610880:12345-0@lo:503: 00000100:00100000:1.0:1788918441.565572:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865610880:12345-0@lo:503: Request processed in 85us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918441.565579:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788918441.565640:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865610880:0@lo:503: 00000040:00080000:3.0:1788918441.565843:0:7979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788918441.565944:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611008:0@lo:502: 00000100:00100000:3.0:1788918441.565974:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918441.565993:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbd5a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918441.566115:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865611008 00000100:00100000:1.0:1788918441.566119:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865611008 00000100:00100000:1.0:1788918441.566148:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788918441.566155:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865611008:12345-0@lo:502: 00000100:00100000:1.0:1788918441.566327:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865611008:12345-0@lo:502: Request processed in 172us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918441.566334:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788918441.566339:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611008:0@lo:502: 00000040:00080000:3.0:1788918441.566568:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788918441.566594:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788918441.566611:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788918441.566623:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788918441.566635:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788918441.566646:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788918441.566665:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611136:0@lo:502: 00000100:00100000:3.0:1788918441.566699:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918441.566731:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbd5a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918441.566819:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865611136 00000100:00100000:1.0:1788918441.566824:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865611136 00000100:00100000:1.0:1788918441.566851:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788918441.566910:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865611136:12345-0@lo:502: 00000100:00100000:1.0:1788918441.566985:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865611136:12345-0@lo:502: Request processed in 128us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918441.566999:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788918441.567110:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611136:0@lo:502: 00000040:00080000:3.0:1788918441.567145:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788918441.567152:0:7979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788918441.567658:0:7990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788918441.567665:0:7990:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788918441.567671:0:7990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918441.567673:0:7990:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788918441.567684:0:7990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788918441.567703:0:7990:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff94fff6b8cd40) 00000020:00000080:3.0:1788918441.567719:0:7990:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788918441.567724:0:7990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788918441.567774:0:7990:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94ffef803800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788918441.567779:0:7990:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788918441.567784:0:7990:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2811b8b2b0ac8bd1 00010000:00010000:3.0:1788918441.573727:0:7990:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788918441.574698:0:7990:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788918441.579272:0:7990:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788918441.579547:0:7990:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788918441.581512:0:7990:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788918441.581624:0:7990:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788918441.588114:0:7990:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788918441.589570:0:7990:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788918441.589580:0:7990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788918441.589586:0:7990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918441.589588:0:7990:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788918441.589593:0:7990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788918441.589597:0:7990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918441.589599:0:7990:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788918441.589602:0:7990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788918441.589603:0:7990:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788918441.589622:0:7990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788918441.589625:0:7990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918441.589627:0:7990:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788918441.589630:0:7990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788918441.589991:0:7979:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788918441.590411:0:7979:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788918441.590465:0:7979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8bc3 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.590490:0:7979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8bc3 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918441.590499:0:7979:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94ffef803800 from 1 10000000:01000000:2.0:1788918441.590502:0:7979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788918441.590537:0:7979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.590544:0:7979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.590555:0:7979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918441.590576:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611264:0@lo:101: 00000100:00100000:2.0:1788918441.590635:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918441.590687:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd80f80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918441.590748:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865611264 00000100:00100000:1.0:1788918441.590754:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865611264 00000100:00100000:1.0:1788918441.590800:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788918441.590809:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:7979:x1875816865611264:12345-0@lo:101: 00010000:00010000:1.0:1788918441.590821:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918441.590842:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8bdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8bd8 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.590863:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8bdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8bd8 expref: 13 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.590874:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8bdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8bd8 expref: 13 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918441.590882:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1492200, rc 0) 00000100:00100000:1.0:1788918441.590925:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7979:x1875816865611264:12345-0@lo:101: Request processed in 117us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918441.590932:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788918441.591043:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611264:0@lo:101: 00010000:00010000:2.0:1788918441.591056:0:7979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8bdf expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.591065:0:7979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8bdf expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918441.591133:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611392:0@lo:501: 00000100:00100000:2.0:1788918441.591157:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918441.591173:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd80f80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918441.591246:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865611392 00000100:00100000:1.0:1788918441.591251:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865611392 00000100:00100000:1.0:1788918441.591278:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788918441.591284:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7979:x1875816865611392:12345-0@lo:501: 00000100:00100000:1.0:1788918441.591360:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7979:x1875816865611392:12345-0@lo:501: Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918441.591367:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788918441.591433:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611392:0@lo:501: 00000100:00100000:2.0:1788918441.591457:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611520:0@lo:503: 00000100:00100000:2.0:1788918441.591491:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918441.591510:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd80f80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918441.591526:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865611520 00000100:00100000:2.0:1788918441.591529:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865611520 00000100:00100000:2.0:1788918441.591561:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788918441.591568:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7979:x1875816865611520:12345-0@lo:503: 00000100:00100000:2.0:1788918441.591640:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7979:x1875816865611520:12345-0@lo:503: Request processed in 72us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918441.591646:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788918441.591691:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611520:0@lo:503: 00000040:00080000:2.0:1788918441.591876:0:7979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788918441.591927:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611648:0@lo:502: 00000100:00100000:2.0:1788918441.591960:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918441.591973:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd80f80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918441.591985:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865611648 00000100:00100000:2.0:1788918441.591988:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865611648 00000100:00100000:2.0:1788918441.592008:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788918441.592014:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7979:x1875816865611648:12345-0@lo:502: 00000100:00100000:2.0:1788918441.592108:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7979:x1875816865611648:12345-0@lo:502: Request processed in 94us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918441.592114:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788918441.592149:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611648:0@lo:502: 00000040:00080000:2.0:1788918441.592323:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788918441.592346:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788918441.592372:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611776:0@lo:502: 00000100:00100000:2.0:1788918441.592404:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918441.592417:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffcbc63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918441.592429:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865611776 00000100:00100000:2.0:1788918441.592432:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865611776 00000100:00100000:2.0:1788918441.592452:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788918441.592457:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7979:x1875816865611776:12345-0@lo:502: 00000100:00100000:2.0:1788918441.592515:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7979:x1875816865611776:12345-0@lo:502: Request processed in 57us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918441.592521:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788918441.592558:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611776:0@lo:502: 00000040:00080000:2.0:1788918441.592592:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788918441.592599:0:7979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788918441.593249:0:7994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788918441.593257:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918441.593260:0:7994:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788918441.593268:0:7994:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94ffef803800 00000020:00000080:1.0:1788918441.593271:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788918441.593282:0:7994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788918441.593285:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918441.593287:0:7994:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788918441.593290:0:7994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788918441.593442:0:7979:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788918441.593461:0:7979:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788918441.593632:0:7979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8bdf expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.593641:0:7979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8bdf expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918441.593685:0:7979:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788918441.593689:0:7979:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94ffef803800 10000000:01000000:2.0:1788918441.593692:0:7979:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94ffef803800 10000000:01000000:2.0:1788918441.593695:0:7979:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788918441.593700:0:7979:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94ffef803800 from 1 10000000:01000000:2.0:1788918441.593703:0:7979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788918441.593720:0:7979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.593738:0:7979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.593747:0:7979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918441.593761:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611904:0@lo:101: 00000100:00100000:2.0:1788918441.593798:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918441.593822:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865611904 00000100:00100000:2.0:1788918441.593839:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865611904 00000100:00100000:2.0:1788918441.593865:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788918441.593872:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:7979:x1875816865611904:12345-0@lo:101: 00010000:00010000:2.0:1788918441.593880:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918441.593890:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8bed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8be6 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.593908:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8be6 expref: 14 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.593916:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8be6 expref: 14 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.593924:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1529800, rc 0) 00000100:00100000:2.0:1788918441.593948:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:7979:x1875816865611904:12345-0@lo:101: Request processed in 76us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918441.593954:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788918441.593986:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffcbc69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918441.594001:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865611904:0@lo:101: 00010000:00010000:2.0:1788918441.594140:0:7979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8bed expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.594150:0:7979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8bed expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918441.594209:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865612032:0@lo:501: 00000100:00100000:2.0:1788918441.594299:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918441.594320:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffcbc69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918441.594381:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865612032 00000100:00100000:1.0:1788918441.594385:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865612032 00000100:00100000:1.0:1788918441.594414:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788918441.594420:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+14:7979:x1875816865612032:12345-0@lo:501: 00000100:00100000:1.0:1788918441.594500:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+14:7979:x1875816865612032:12345-0@lo:501: Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918441.594506:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788918441.595337:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865612032:0@lo:501: 00000100:00100000:2.0:1788918441.595366:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865612160:0@lo:503: 00000100:00100000:2.0:1788918441.595407:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918441.595439:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffcbc69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918441.595500:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865612160 00000100:00100000:0.0:1788918441.595505:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865612160 00000100:00100000:0.0:1788918441.595542:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788918441.595549:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+14:7979:x1875816865612160:12345-0@lo:503: 00000100:00100000:0.0:1788918441.595627:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+14:7979:x1875816865612160:12345-0@lo:503: Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918441.595635:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788918441.595920:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865612160:0@lo:503: 00000040:00080000:2.0:1788918441.596144:0:7979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788918441.596202:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865612288:0@lo:502: 00000100:00100000:2.0:1788918441.596304:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918441.596328:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffcbc69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918441.596340:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865612288 00000100:00100000:0.0:1788918441.596344:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865612288 00000100:00100000:0.0:1788918441.596416:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788918441.596423:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:7979:x1875816865612288:12345-0@lo:502: 00000100:00100000:0.0:1788918441.596567:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:7979:x1875816865612288:12345-0@lo:502: Request processed in 144us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918441.596574:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788918441.596921:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865612288:0@lo:502: 00000040:00080000:2.0:1788918441.597114:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788918441.597142:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788918441.597166:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788918441.597181:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788918441.597192:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788918441.597202:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788918441.597214:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788918441.597888:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788918441.597923:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788918441.597937:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788918441.597951:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788918441.597963:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788918441.597978:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788918441.597991:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788918441.598004:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788918441.598064:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788918441.598083:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788918441.598095:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788918441.598119:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788918441.598133:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788918441.598146:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788918441.598157:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788918441.598169:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788918441.598180:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788918441.598191:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788918441.598203:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788918441.598215:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788918441.598238:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788918441.598253:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788918441.598264:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788918441.598278:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788918441.598290:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788918441.598303:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788918441.598317:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788918441.598341:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788918441.598356:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788918441.598370:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788918441.598397:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865612416:0@lo:502: 00000100:00100000:2.0:1788918441.598448:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918441.598480:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffcbc69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918441.598783:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865612416 00000100:00100000:3.0:1788918441.598789:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865612416 00000100:00100000:3.0:1788918441.598821:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788918441.598841:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+14:7979:x1875816865612416:12345-0@lo:502: 00000100:00100000:3.0:1788918441.598928:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+14:7979:x1875816865612416:12345-0@lo:502: Request processed in 100us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918441.598934:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788918441.599502:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865612416:0@lo:502: 00000040:00080000:2.0:1788918441.599547:0:7979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788918441.599556:0:7979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788918441.600080:0:7995:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788918441.600094:0:7995:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff94fffca38000) 00000020:00000080:2.0:1788918441.600113:0:7995:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788918441.600189:0:7995:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94ffef803800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788918441.600193:0:7995:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94ffef803800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788918441.600195:0:7995:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94ffef803800 3 00010000:00080000:2.0:1788918441.600220:0:7995:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94ffff5fa800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.149@tcp at head 00010000:00010000:2.0:1788918441.603741:0:7995:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788918441.604187:0:7995:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788918441.604288:0:7995:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788918441.604301:0:7995:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2811b8b2b0ac8bfb 00000100:00080000:2.0:1788918441.604311:0:7995:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788918441.604317:0:7995:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94ffff5fa800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788918441.604347:0:7995:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffe8d9aa00 x1875816865612544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788918441.604479:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3416:1875816865612544:0@lo:38: 00000100:00100000:3.0:1788918441.604544:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918441.604583:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865612544 00000100:00100000:1.0:1788918441.604591:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865612544 00000100:00080000:2.0:1788918441.604599:0:7995:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788918441.605076:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788918441.605085:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3416:x1875816865612544:12345-0@lo:38: 00010000:00080000:1.0:1788918441.605117:0:5924:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 143 last 0 00000020:00000080:1.0:1788918441.605144:0:5924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2811b8b2b0ac8c02 00000004:00100000:1.0:1788918441.605160:0:5924:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788918441.605190:0:5924:0:(import.c:65:import_set_state_nolock()) ffff94ffff5e3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788918441.606220:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3416:x1875816865612544:12345-0@lo:38: Request processed in 1131us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918441.606239:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788918441.606337:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865612800:0@lo:400: 00000100:00100000:1.0:1788918441.606387:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918441.606410:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788918441.606416:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865612672:0@lo:400: 00000100:00100000:1.0:1788918441.606439:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918441.606461:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865612928:0@lo:400: 00000100:00100000:1.0:1788918441.606485:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918441.606518:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865612800 00000100:00100000:1.0:1788918441.606523:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865612800 00000100:00100000:1.0:1788918441.606562:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865612672 00000100:00100000:1.0:1788918441.606566:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865612672 00000100:00100000:1.0:1788918441.606582:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788918441.606588:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865612800:12345-0@lo:400: 00000100:00100000:1.0:1788918441.606626:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865612800:12345-0@lo:400: Request processed in 37us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918441.606632:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788918441.606644:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788918441.606650:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865612672:12345-0@lo:400: 00000100:00100000:1.0:1788918441.606676:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865612672:12345-0@lo:400: Request processed in 26us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918441.606688:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788918441.606705:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865612928 00000100:00100000:1.0:1788918441.606709:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865612928 00000100:00100000:1.0:1788918441.606737:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788918441.606744:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865612928:12345-0@lo:400: 00000100:00100000:1.0:1788918441.606779:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865612928:12345-0@lo:400: Request processed in 36us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918441.606786:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788918441.606800:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788918441.606804:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788918441.606843:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94fffc876d80 x1875816865612928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918441.606857:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865612928:0@lo:400: 00010000:00080000:1.0:1788918441.606889:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94fffc875f80 x1875816865612672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918441.606898:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865612672:0@lo:400: 00010000:00080000:1.0:1788918441.606907:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94fffc877480 x1875816865612800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918441.606915:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865612800:0@lo:400: 00010000:00080000:3.0:1788918441.607177:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffe8d9aa00 x1875816865612544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788918451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918441.607188:0:3416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788918441.607196:0:3416:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788918441.607202:0:3416:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788918441.607207:0:3416:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788918441.607209:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94ffff5fa800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788918441.607225:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3416:1875816865612544:0@lo:38: 00000040:00080000:2.0:1788918441.607469:0:7995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788918441.607648:0:7979:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788918441.607676:0:7979:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788918441.607710:0:7979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8bed expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.607721:0:7979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8bed expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788918441.607769:0:7979:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788918441.607772:0:7979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788918441.607773:0:7979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788918441.607775:0:7979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788918441.607776:0:7979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788918441.607778:0:7979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788918441.607779:0:7979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788918441.607781:0:7979:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788918441.607782:0:7979:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788918441.607784:0:7979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788918441.607785:0:7979:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788918441.607790:0:7979:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788918441.607792:0:7979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788918441.607794:0:7979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788918441.607795:0:7979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788918441.607796:0:7979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788918441.607797:0:7979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788918441.607798:0:7979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788918441.607799:0:7979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788918441.607801:0:7979:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788918441.607802:0:7979:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788918441.607802:0:7979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788918441.607803:0:7979:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788918441.607820:0:7979:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788918441.607836:0:7979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865613056:0@lo:253: 00000100:00100000:3.0:1788918441.607881:0:7979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918441.607911:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865613056 00000100:00100000:3.0:1788918441.607915:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865613056 00000100:00100000:3.0:1788918441.607944:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788918441.607951:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:7979:x1875816865613056:12345-0@lo:253: 20000000:01000000:3.0:1788918441.607976:0:5917:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788918441.607988:0:5917:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788918441.608165:0:7979:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbd5a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918441.610139:0:7996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7996:1875816865613184:0@lo:901: 00000100:00100000:1.0:1788918441.610197:0:7996:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918441.610225:0:7996:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffca15540 going to sleep for 11 seconds 20000000:01000000:3.0:1788918441.613104:0:5917:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788918441.613120:0:5917:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788918441.613201:0:5940:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788918441.613205:0:5940:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788918441.613237:0:5940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.613254:0:5940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1481e00/0x2811b8b2b0ac8b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b53 expref: 14 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.613263:0:5940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.613304:0:5940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1481e00/0x2811b8b2b0ac8b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8b53 expref: 14 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.613318:0:5940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1481e00/0x2811b8b2b0ac8b5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b53 expref: 14 pid: 5918 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918441.613330:0:5940:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5940:1875816865613312:0@lo:104: 00000100:00100000:2.0:1788918441.613496:0:5940:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918441.613536:0:5940:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe0bdbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918441.613634:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865613312 00000100:00100000:3.0:1788918441.613642:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865613312 00000100:00100000:3.0:1788918441.613683:0:5908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788918441.613691:0:5908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+3:5940:x1875816865613312:12345-0@lo:104: 00010000:00010000:3.0:1788918441.613704:0:5908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8b5a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.613751:0:5908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788918441.613756:0:5908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+3:5940:x1875816865613312:12345-0@lo:104: Request processed in 66us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918441.613763:0:5908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788918441.615524:0:5935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865613184 00000100:00100000:0.0:1788918441.615531:0:5935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865613184 00000100:00100000:0.0:1788918441.615572:0:5935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788918441.615578:0:5935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7996:x1875816865613184:12345-0@lo:901: 00000100:00100000:0.0:1788918441.615658:0:5935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7996:x1875816865613184:12345-0@lo:901: Request processed in 79us (5461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918441.615664:0:5935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788918441.615709:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788918441.615736:0:7996:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94fffc877480 x1875816865613184/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788918457 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918441.615760:0:7996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7996:1875816865613184:0@lo:901: 00000100:00100000:0.0:1788918441.617437:0:5940:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5940:1875816865613312:0@lo:104: 00010000:00010000:0.0:1788918441.617469:0:5940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.617765:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918441.617773:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8b5a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.617781:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030800 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918441.617786:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8b5a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.617795:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8b5a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918441.617802:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8b5a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918441.617818:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788918441.617852:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b5a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.617859:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918441.617877:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b5a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.617884:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac8b53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b5a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918441.617899:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918441.617901:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918441.617903:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918441.618303:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:7979:x1875816865613056:12345-0@lo:253: Request processed in 10351us (10420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918441.618313:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788918441.618350:0:7979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74aa73a2-313d-4992-b461-72ab8c3ab246:7979:1875816865613056:0@lo:253: 10000000:01000000:3.0:1788918441.618361:0:7979:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788918441.618364:0:7979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788918441.618366:0:7979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788918441.618368:0:7979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788918441.618369:0:7979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788918441.618370:0:7979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788918441.618371:0:7979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788918441.618372:0:7979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788918441.618373:0:7979:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788918441.618375:0:7979:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788918441.618377:0:7979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788918441.618378:0:7979:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788918441.618387:0:7979:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788918441.619986:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865613440:0@lo:103: 00000100:00100000:1.0:1788918441.620186:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918441.620327:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865613440 00000100:00100000:2.0:1788918441.620335:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865613440 00010000:00010000:2.0:1788918441.620363:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1481e00/0x2811b8b2b0ac8b5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b53 expref: 14 pid: 5918 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918441.620399:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788918441.620409:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe31050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+14:3418:x1875816865613440:12345-0@lo:103: 00010000:00010000:2.0:1788918441.620421:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918441.620427:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1481e00/0x2811b8b2b0ac8b5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b53 expref: 14 pid: 5918 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.620439:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1481e00/0x2811b8b2b0ac8b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b53 expref: 14 pid: 5918 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.620455:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1481e00/0x2811b8b2b0ac8b5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b53 expref: 14 pid: 5918 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.620484:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.620492:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788918441.620506:0:7989:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007301881s 00010000:00010000:2.0:1788918441.620511:0:7989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.620518:0:7989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.620524:0:7989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.620531:0:7989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.620537:0:7989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1529200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918441.620542:0:7989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.620550:0:7989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.620570:0:7989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918441.620579:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918441.620590:0:5940:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.620602:0:5940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918441.620609:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1529200/0x2811b8b2b0ac8c09 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918441.620625:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe31050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+13:3418:x1875816865613440:12345-0@lo:103: Request processed in 217us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918441.620633:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788918441.620672:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865613440:0@lo:103: 00080000:10000000:2.0:1788918441.623839:0:7979:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788918441.623987:0:7979:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788918441.624440:0:7979:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788918441.624599:0:7979:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788918441.624799:0:7979:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788918441.624983:0:7979:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788918441.626325:0:7979:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788918441.632930:0:7979:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788918441.632938:0:7979:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788918441.632971:0:7979:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788918441.633007:0:7979:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.149@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788918441.633170:0:7979:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788918441.633190:0:7979:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788918441.634557:0:7979:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788918441.634711:0:7979:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1788918442.070670:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865613568:0@lo:13: 00000100:00100000:3.0:1788918442.070743:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918442.070820:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865613568 00000100:00100000:3.0:1788918442.070838:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865613568 00000100:00100000:3.0:1788918442.070896:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788918442.070904:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865613568:12345-0@lo:13: 00002000:00000024:3.0:1788918442.070930:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918442.070967:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865613568:12345-0@lo:13: Request processed in 64us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918442.070974:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788918442.071042:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffe8d82d80 x1875816865613568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918442.071060:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865613568:0@lo:13: 00000020:00000004:2.0:1788918442.387008:0:8049:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788918442.388794:0:8049:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788918442.521877:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918443.544574:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918444.567218:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918445.590156:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788918446.376690:0:8339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788918446.614531:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788918446.678332:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788918446.678341:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94fffcaac000 from 30 10000000:01000000:0.0:1788918446.678346:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788918446.678392:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918446.678404:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918446.678416:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918446.678440:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865613696:0@lo:101: 00000100:00100000:0.0:1788918446.678509:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918446.678567:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2fb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788918446.678799:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865613696 00000100:00100000:2.0:1788918446.678806:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865613696 00000100:00100000:2.0:1788918446.678862:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788918446.678872:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+13:5921:x1875816865613696:12345-0@lo:101: 00010000:00010000:2.0:1788918446.678885:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918446.678898:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8c17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8c10 expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.678941:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c10 expref: 14 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.678951:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c10 expref: 14 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.678959:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1529a00, rc 0) 00000100:00100000:2.0:1788918446.679054:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865613696:12345-0@lo:101: Request processed in 183us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918446.679061:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788918446.680121:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865613696:0@lo:101: 00010000:00010000:1.0:1788918446.680140:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c17 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918446.680151:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8c17 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918446.680216:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865613824:0@lo:501: 00000100:00100000:1.0:1788918446.680254:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918446.680277:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc5319180 going to sleep for 11 seconds 00000100:00100000:1.0:1788918446.680448:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865613952:0@lo:400: 00000100:00100000:3.0:1788918446.680459:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865614336:0@lo:400: 00000100:00100000:1.0:1788918446.680478:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918446.680485:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865614080:0@lo:400: 00000100:00100000:3.0:1788918446.680506:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918446.680524:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788918446.680526:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865613952 00000100:00100000:3.0:1788918446.680530:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865614208:0@lo:400: 00000100:00100000:3.0:1788918446.680552:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918446.680580:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865614080 00000100:00100000:3.0:1788918446.680584:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865614080 00000100:00100000:3.0:1788918446.680622:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788918446.680630:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865614080:12345-0@lo:400: 00000100:00100000:3.0:1788918446.680666:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865614080:12345-0@lo:400: Request processed in 37us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918446.680672:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788918446.680703:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865614208 00000100:00100000:3.0:1788918446.680707:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865614208 00000100:00100000:3.0:1788918446.680859:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788918446.680868:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865614208:12345-0@lo:400: 00000100:00100000:3.0:1788918446.680899:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865614208:12345-0@lo:400: Request processed in 33us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918446.680904:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788918446.680921:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788918446.680925:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918446.680940:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788918446.680988:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffc70c0000 x1875816865614208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918446.681000:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865614208:0@lo:400: 00010000:00080000:3.0:1788918446.681012:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffc70c1180 x1875816865614080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918446.681042:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865614080:0@lo:400: 00000100:00100000:3.0:1788918446.681062:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865614336 00000100:00100000:3.0:1788918446.681065:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865614336 00000100:00100000:3.0:1788918446.681091:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788918446.681097:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865614336:12345-0@lo:400: 00000100:00100000:3.0:1788918446.681130:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865614336:12345-0@lo:400: Request processed in 33us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918446.681136:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788918446.681150:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918446.681153:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865613952 00010000:00080000:3.0:1788918446.681164:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffc70c1f80 x1875816865614336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918446.681174:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865614336:0@lo:400: 00000100:00100000:1.0:1788918446.681178:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788918446.681184:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865613952:12345-0@lo:400: 00000100:00100000:1.0:1788918446.681216:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865613952:12345-0@lo:400: Request processed in 32us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918446.681222:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788918446.681233:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffc70c0700 x1875816865613952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918446.681242:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865613952:0@lo:400: 00000100:00100000:2.0:1788918446.681415:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865613824 00000100:00100000:2.0:1788918446.681420:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865613824 00000100:00100000:2.0:1788918446.681458:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788918446.681466:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865613824:12345-0@lo:501: 00000100:00100000:2.0:1788918446.682137:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865613824:12345-0@lo:501: Request processed in 670us (1881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918446.682144:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788918446.682386:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865613824:0@lo:501: 00000100:00100000:1.0:1788918446.682431:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865614464:0@lo:503: 00000100:00100000:1.0:1788918446.682473:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918446.682503:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc5319180 going to sleep for 11 seconds 00000100:00100000:3.0:1788918446.682520:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865614464 00000100:00100000:3.0:1788918446.682526:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865614464 00000100:00100000:3.0:1788918446.682555:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788918446.682562:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865614464:12345-0@lo:503: 00000100:00100000:3.0:1788918446.682651:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865614464:12345-0@lo:503: Request processed in 90us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918446.682659:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788918446.682706:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865614464:0@lo:503: 00000100:00100000:2.0:1788918446.683739:0:8361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8361:1875816865614592:0@lo:502: 00000100:00100000:2.0:1788918446.683790:0:8361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918446.683840:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865614592 00000100:00100000:0.0:1788918446.683847:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865614592 00000100:00100000:2.0:1788918446.683888:0:8361:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788918446.683893:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788918446.683902:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:8361:x1875816865614592:12345-0@lo:502: 00000100:00100000:0.0:1788918446.684015:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:8361:x1875816865614592:12345-0@lo:502: Request processed in 115us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918446.684045:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788918446.684336:0:8361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8361:1875816865614592:0@lo:502: 00000100:00100000:2.0:1788918446.684382:0:8361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8361:1875816865614720:0@lo:502: 00000100:00100000:2.0:1788918446.684415:0:8361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918446.684443:0:8361:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788918446.684552:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865614720 00000100:00100000:0.0:1788918446.684557:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865614720 00000100:00100000:0.0:1788918446.684588:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788918446.684595:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+14:8361:x1875816865614720:12345-0@lo:502: 00000100:00100000:0.0:1788918446.684692:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+14:8361:x1875816865614720:12345-0@lo:502: Request processed in 98us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918446.684699:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788918446.684750:0:8361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8361:1875816865614720:0@lo:502: 00000040:00080000:3.0:1788918446.684782:0:8361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788918446.687797:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788918446.687835:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788918446.687847:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c17 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918446.687859:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c17 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918446.687870:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788918446.687878:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788918446.687881:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788918446.687920:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918446.687928:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918446.687939:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918446.687961:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865614848:0@lo:101: 00000100:00100000:1.0:1788918446.688046:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918446.688085:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc5319180 going to sleep for 11 seconds 00000100:00100000:3.0:1788918446.691847:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865614848 00000100:00100000:3.0:1788918446.691861:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865614848 00000100:00100000:3.0:1788918446.691907:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788918446.691916:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865614848:12345-0@lo:101: 00010000:00010000:3.0:1788918446.691931:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918446.691949:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8c25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8c1e expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918446.691987:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c1e expref: 15 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918446.691998:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c1e expref: 15 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918446.692008:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4e00, rc 0) 00000100:00100000:3.0:1788918446.692129:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865614848:12345-0@lo:101: Request processed in 214us (4083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918446.692136:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788918446.694461:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865614848:0@lo:101: 00010000:00010000:1.0:1788918446.694494:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c25 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918446.694506:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8c25 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918446.694594:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865614976:0@lo:501: 00000100:00100000:1.0:1788918446.694643:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918446.694685:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc5319180 going to sleep for 11 seconds 00000100:00100000:2.0:1788918446.694692:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865614976 00000100:00100000:2.0:1788918446.694698:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865614976 00000100:00100000:2.0:1788918446.694858:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788918446.694868:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865614976:12345-0@lo:501: 00000100:00100000:2.0:1788918446.695009:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865614976:12345-0@lo:501: Request processed in 142us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918446.695016:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788918446.696331:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865614976:0@lo:501: 00000100:00100000:1.0:1788918446.696370:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865615104:0@lo:503: 00000100:00100000:1.0:1788918446.696421:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918446.696912:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc5319180 going to sleep for 11 seconds 00000100:00100000:3.0:1788918446.696950:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865615104 00000100:00100000:3.0:1788918446.696956:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865615104 00000100:00100000:3.0:1788918446.696998:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788918446.697007:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865615104:12345-0@lo:503: 00000100:00100000:3.0:1788918446.697115:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865615104:12345-0@lo:503: Request processed in 109us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918446.697122:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788918446.697314:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865615104:0@lo:503: 00000100:00100000:2.0:1788918446.697941:0:8362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8362:1875816865615232:0@lo:502: 00000100:00100000:2.0:1788918446.697998:0:8362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918446.698056:0:8362:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788918446.698132:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865615232 00000100:00100000:3.0:1788918446.698138:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865615232 00000100:00100000:3.0:1788918446.698162:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788918446.698169:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+15:8362:x1875816865615232:12345-0@lo:502: 00000100:00100000:3.0:1788918446.698253:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+15:8362:x1875816865615232:12345-0@lo:502: Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918446.698259:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788918446.698386:0:8362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8362:1875816865615232:0@lo:502: 00000020:01000000:2.0:1788918446.698411:0:8362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918446.698418:0:8362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918446.698421:0:8362:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788918446.698429:0:8362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788918446.698431:0:8362:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788918446.698450:0:8362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8362:1875816865615360:0@lo:502: 00000100:00100000:2.0:1788918446.698485:0:8362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918446.698551:0:8362:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788918446.698658:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865615360 00000100:00100000:1.0:1788918446.698662:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865615360 00000100:00100000:1.0:1788918446.698722:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788918446.698730:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+15:8362:x1875816865615360:12345-0@lo:502: 00000100:00100000:1.0:1788918446.698823:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+15:8362:x1875816865615360:12345-0@lo:502: Request processed in 94us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918446.698830:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788918446.698893:0:8362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8362:1875816865615360:0@lo:502: 00000020:01000000:2.0:1788918446.698910:0:8362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918446.698914:0:8362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918446.698915:0:8362:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788918446.698920:0:8362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788918446.699143:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788918446.699164:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788918446.699173:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c25 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918446.699183:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c25 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918446.699199:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788918446.699201:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94fffbe70000 from 30 10000000:01000000:1.0:1788918446.699204:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788918446.699225:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918446.699232:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918446.699241:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918446.699254:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865615488:0@lo:101: 00000100:00100000:1.0:1788918446.699281:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918446.699335:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc5319e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788918446.699380:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865615488 00000100:00100000:2.0:1788918446.699384:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865615488 00000100:00100000:2.0:1788918446.699438:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788918446.699446:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865615488:12345-0@lo:101: 00010000:00010000:2.0:1788918446.699455:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918446.699473:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac8c33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8c2c expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.699493:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac8c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c2c expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.699503:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac8c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c2c expref: 16 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.699511:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1528e00, rc 0) 00000100:00100000:2.0:1788918446.699554:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865615488:12345-0@lo:101: Request processed in 109us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918446.699560:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788918446.699614:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865615488:0@lo:101: 00010000:00010000:1.0:1788918446.699625:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c33 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918446.699634:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8c33 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918446.699675:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865615616:0@lo:501: 00000100:00100000:1.0:1788918446.699698:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918446.699829:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc5319e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788918446.699870:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865615616 00000100:00100000:3.0:1788918446.699874:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865615616 00000100:00100000:3.0:1788918446.699894:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788918446.699900:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865615616:12345-0@lo:501: 00000100:00100000:3.0:1788918446.700010:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865615616:12345-0@lo:501: Request processed in 110us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918446.700017:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788918446.700159:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865615616:0@lo:501: 00000100:00100000:1.0:1788918446.700188:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865615744:0@lo:503: 00000100:00100000:1.0:1788918446.700227:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918446.700279:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc5319e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788918446.700319:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865615744 00000100:00100000:3.0:1788918446.700323:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865615744 00000100:00100000:3.0:1788918446.700375:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788918446.700382:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865615744:12345-0@lo:503: 00000100:00100000:3.0:1788918446.700457:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865615744:12345-0@lo:503: Request processed in 76us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918446.700464:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788918446.700528:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865615744:0@lo:503: 00000100:00100000:2.0:1788918446.701233:0:8363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8363:1875816865615872:0@lo:502: 00000100:00100000:2.0:1788918446.701272:0:8363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918446.701330:0:8363:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918446.701391:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865615872 00000100:00100000:3.0:1788918446.701396:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865615872 00000100:00100000:3.0:1788918446.701452:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788918446.701460:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:8363:x1875816865615872:12345-0@lo:502: 00000100:00100000:3.0:1788918446.701643:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:8363:x1875816865615872:12345-0@lo:502: Request processed in 184us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918446.701651:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788918446.701714:0:8363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8363:1875816865615872:0@lo:502: 00000100:00100000:0.0:1788918446.701754:0:8363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8363:1875816865616000:0@lo:502: 00000100:00100000:0.0:1788918446.701789:0:8363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918446.701986:0:8363:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbd5aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788918446.702082:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865616000 00000100:00100000:2.0:1788918446.702086:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865616000 00000100:00100000:2.0:1788918446.702107:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788918446.702113:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+16:8363:x1875816865616000:12345-0@lo:502: 00000100:00100000:2.0:1788918446.702181:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+16:8363:x1875816865616000:12345-0@lo:502: Request processed in 67us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918446.702188:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788918446.702278:0:8363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8363:1875816865616000:0@lo:502: 00000040:00080000:0.0:1788918446.702296:0:8363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788918446.702432:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788918446.702452:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788918446.702461:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c33 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.702471:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c33 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918446.702487:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788918446.702489:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94fffbe70000 from 5 10000000:01000000:2.0:1788918446.702492:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788918446.702514:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.702522:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.702544:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918446.702557:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865616128:0@lo:101: 00000100:00100000:2.0:1788918446.702582:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918446.702603:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788918446.702708:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865616128 00000100:00100000:0.0:1788918446.702712:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865616128 00000100:00100000:0.0:1788918446.702731:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788918446.702736:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865616128:12345-0@lo:101: 00010000:00010000:0.0:1788918446.702744:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918446.702758:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc0031000/0x2811b8b2b0ac8c41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8c3a expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918446.702776:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc0031000/0x2811b8b2b0ac8c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c3a expref: 17 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918446.702798:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc0031000/0x2811b8b2b0ac8c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c3a expref: 17 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918446.702806:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0031000, rc 0) 00000100:00100000:0.0:1788918446.702845:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865616128:12345-0@lo:101: Request processed in 108us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918446.702851:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788918446.702907:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865616128:0@lo:101: 00010000:00010000:2.0:1788918446.702918:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.702927:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918446.702965:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865616256:0@lo:256: 00000100:00100000:2.0:1788918446.703006:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918446.703087:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fb300 going to sleep for 11 seconds 00000100:00100000:3.0:1788918446.703145:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865616256 00000100:00100000:3.0:1788918446.703149:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865616256 00000100:00100000:1.0:1788918446.703201:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788918446.703210:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865616256:12345-0@lo:256: 20000000:01000000:1.0:1788918446.703223:0:5916:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788918446.703239:0:5916:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788918446.703242:0:5916:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788918446.703322:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865616256:12345-0@lo:256: Request processed in 113us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918446.703329:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788918446.703376:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865616256:0@lo:256: 10000000:01000000:2.0:1788918446.703415:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788918446.703424:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.703433:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918446.703440:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788918446.703441:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788918446.703444:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788918446.703470:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.703478:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.703486:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918446.703498:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865616384:0@lo:101: 00000100:00100000:2.0:1788918446.703520:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918446.703664:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788918446.703716:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865616384 00000100:00100000:0.0:1788918446.703721:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865616384 00000100:00100000:0.0:1788918446.703740:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788918446.703746:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865616384:12345-0@lo:101: 00010000:00010000:0.0:1788918446.703752:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918446.703761:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac8c4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8c48 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918446.703776:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac8c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c48 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918446.703784:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac8c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c48 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918446.703791:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0030800, rc 0) 00000100:00100000:0.0:1788918446.703826:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865616384:12345-0@lo:101: Request processed in 80us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918446.703831:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788918446.703887:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865616384:0@lo:101: 00010000:00010000:2.0:1788918446.703897:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c4f expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.703906:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8c4f expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918446.703942:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865616512:0@lo:501: 00000100:00100000:2.0:1788918446.703965:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918446.703992:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788918446.704042:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865616512 00000100:00100000:0.0:1788918446.704045:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865616512 00000100:00100000:0.0:1788918446.704057:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788918446.704065:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865616512:12345-0@lo:501: 00000100:00100000:0.0:1788918446.704144:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865616512:12345-0@lo:501: Request processed in 79us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918446.704149:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788918446.704198:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865616512:0@lo:501: 00000100:00100000:2.0:1788918446.704215:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865616640:0@lo:503: 00000100:00100000:2.0:1788918446.704239:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918446.704255:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788918446.704285:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865616640 00000100:00100000:0.0:1788918446.704288:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865616640 00000100:00100000:0.0:1788918446.704299:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788918446.704302:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865616640:12345-0@lo:503: 00000100:00100000:0.0:1788918446.704356:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865616640:12345-0@lo:503: Request processed in 53us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918446.704361:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788918446.704416:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865616640:0@lo:503: 00000100:00100000:2.0:1788918446.704865:0:8364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8364:1875816865616768:0@lo:502: 00000100:00100000:2.0:1788918446.704891:0:8364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918446.704935:0:8364:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918446.704956:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865616768 00000100:00100000:0.0:1788918446.704959:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865616768 00000100:00100000:0.0:1788918446.704998:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788918446.705005:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:8364:x1875816865616768:12345-0@lo:502: 00000100:00100000:0.0:1788918446.705232:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:8364:x1875816865616768:12345-0@lo:502: Request processed in 228us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918446.705237:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788918446.705291:0:8364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8364:1875816865616768:0@lo:502: 00000020:01000000:2.0:1788918446.705308:0:8364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788918446.705313:0:8364:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788918446.705319:0:8364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918446.705320:0:8364:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788918446.705327:0:8364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788918446.705329:0:8364:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.149@tcp to nid 0x20000c0a8ca95 (192.168.202.149@tcp) 00000020:01000000:2.0:1788918446.705346:0:8364:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788918446.705348:0:8364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788918446.705360:0:8364:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff94fffca3cd40) 00000020:00000080:2.0:1788918446.705375:0:8364:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788918446.705379:0:8364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788918446.705441:0:8364:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788918446.705445:0:8364:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788918446.705449:0:8364:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac8c5d 00010000:00080000:2.0:1788918446.705470:0:8364:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94fffc8e5000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.149@tcp at head 00010000:00010000:2.0:1788918446.705666:0:8364:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788918446.705759:0:8364:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788918446.705766:0:8364:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788918446.705900:0:8364:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788918446.706010:0:8364:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788918446.706338:0:8364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788918446.706394:0:8364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788918446.706698:0:8365:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788918446.706702:0:8365:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788918446.707335:0:8364:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788918446.707343:0:8364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788918446.707368:0:8364:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788918446.707384:0:8364:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2811b8b2b0ac8c64 00000100:00080000:2.0:1788918446.707391:0:8364:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788918446.707396:0:8364:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94fffc8e5000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788918446.707419:0:8364:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffe8d99c00 x1875816865616896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788918446.707467:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865616896:0@lo:8: 00000100:00100000:3.0:1788918446.707525:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918446.707613:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865616896 00000100:00100000:1.0:1788918446.707619:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865616896 00000100:00100000:1.0:1788918446.707654:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788918446.707660:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3416:x1875816865616896:12345-0@lo:8: 00010000:00080000:1.0:1788918446.707679:0:7258:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:1.0:1788918446.707699:0:7258:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2811b8b2b0ac8c6b 00002000:00100000:1.0:1788918446.707709:0:7258:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff94ffff5e2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788918446.707713:0:7258:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788918446.707716:0:7258:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788918446.707754:0:7258:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788918446.707901:0:7258:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788918446.707920:0:7258:0:(import.c:65:import_set_state_nolock()) ffff94ffff5e0800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788918446.710560:0:8364:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788918446.710700:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3416:x1875816865616896:12345-0@lo:8: Request processed in 3034us (3170us total) trans 0 rc 0/0 00010000:00080000:3.0:1788918446.710702:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d99c00 x1875816865616896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788918456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918446.710711:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788918446.710713:0:3416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788918446.710723:0:3416:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788918446.710730:0:3416:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788918446.710735:0:3416:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788918446.710738:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94fffc8e5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788918446.710809:0:3416:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788918446.710815:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865616896:0@lo:8: 00000020:01000000:2.0:1788918446.710857:0:8364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918446.710866:0:8364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918446.710868:0:8364:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788918446.710870:0:8364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918446.710874:0:8364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918446.710876:0:8364:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788918446.710879:0:8364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788918446.710880:0:8364:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788918446.710916:0:8364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8364:1875816865617024:0@lo:502: 00000100:00100000:2.0:1788918446.710968:0:8364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918446.711011:0:8364:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fb3c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788918446.711083:0:8365:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788918446.711087:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865617024 00000100:00100000:3.0:1788918446.711093:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865617024 00000100:00100000:3.0:1788918446.711132:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788918446.711140:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:8364:x1875816865617024:12345-0@lo:502: 00000004:00080000:1.0:1788918446.711150:0:8365:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 148992129531ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788918446.711156:0:8365:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788918446.711254:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:8364:x1875816865617024:12345-0@lo:502: Request processed in 114us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918446.711261:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788918446.711280:0:8364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8364:1875816865617024:0@lo:502: 00000020:01000000:2.0:1788918446.711298:0:8364:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918446.711302:0:8364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918446.711303:0:8364:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788918446.711312:0:8364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788918446.711396:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788918446.711427:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788918446.711438:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c4f expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918446.711450:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c4f expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918446.711462:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788918446.711465:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94fffbddcd40 from 1 10000000:01000000:3.0:1788918446.711469:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788918446.711506:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918446.711515:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918446.711525:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918446.711542:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865617152:0@lo:101: 00000100:00100000:3.0:1788918446.711576:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918446.711602:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68a7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788918446.711642:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865617152 00000100:00100000:0.0:1788918446.711647:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865617152 00000100:00100000:0.0:1788918446.711678:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788918446.711685:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865617152:12345-0@lo:101: 00010000:00010000:0.0:1788918446.711694:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918446.711761:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8c79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8c72 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918446.711792:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c72 expref: 19 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918446.711802:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c72 expref: 19 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918446.711810:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691e200, rc 0) 00000100:00100000:0.0:1788918446.711845:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865617152:12345-0@lo:101: Request processed in 160us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918446.711851:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788918446.711874:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865617152:0@lo:101: 00010000:00010000:3.0:1788918446.711887:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c79 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918446.711907:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8c79 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918446.711956:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865617280:0@lo:501: 00000100:00100000:3.0:1788918446.711994:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918446.712014:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68a7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788918446.712051:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865617280 00000100:00100000:0.0:1788918446.712056:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865617280 00000100:00100000:0.0:1788918446.712086:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788918446.712093:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865617280:12345-0@lo:501: 00000100:00100000:0.0:1788918446.712157:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865617280:12345-0@lo:501: Request processed in 64us (161us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788918446.712163:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788918446.712232:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865617280:0@lo:501: 10000000:01000000:2.0:1788918446.712252:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788918446.712257:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c79 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918446.712264:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c79 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788918446.712958:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788918446.715004:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865617408:0@lo:13: 00000004:00080000:0.0:1788918446.715006:0:8366:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788918446.715083:0:8366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d83100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8366:1875816865617536:0@lo:7: 00000100:00100000:3.0:1788918446.715104:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918446.715116:0:8366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918446.715170:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865617408 00000100:00100000:2.0:1788918446.715176:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865617408 00000100:00100000:2.0:1788918446.715214:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788918446.715220:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1875816865617408:12345-0@lo:13: 00002000:00000024:2.0:1788918446.715239:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00080000:3.0:1788918446.715269:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788918446.715275:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1875816865617408:12345-0@lo:13: Request processed in 55us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918446.715279:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788918446.715316:0:8366:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788918446.715350:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865617536 00000100:00100000:1.0:1788918446.715353:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865617536 00010000:00080000:3.0:1788918446.715376:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d80a80 x1875816865617408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918446.715397:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865617408:0@lo:13: 00000100:00100000:1.0:1788918446.715402:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788918446.715408:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8366:x1875816865617536:12345-0@lo:7: 00002000:00080000:1.0:1788918446.717729:0:6912:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788918446.717736:0:6912:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788918446.717819:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8366:x1875816865617536:12345-0@lo:7: Request processed in 2407us (2699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918446.717829:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788918446.718043:0:8366:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d83100 x1875816865617536/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788918462 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918446.718057:0:8366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d83100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8366:1875816865617536:0@lo:7: 00000004:00080000:0.0:1788918446.718072:0:8366:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788918446.718105:0:8366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d83100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8366:1875816865617664:0@lo:5: 00000100:00100000:0.0:1788918446.718140:0:8366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918446.718170:0:8366:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788918446.718261:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865617664 00000100:00100000:2.0:1788918446.718266:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865617664 00000100:00100000:2.0:1788918446.718305:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788918446.718315:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8366:x1875816865617664:12345-0@lo:5: 00002000:00080000:2.0:1788918446.718337:0:6911:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788918446.718340:0:6911:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1788918446.720135:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788918446.720148:0:7980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788918446.720278:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8366:x1875816865617664:12345-0@lo:5: Request processed in 1961us (2134us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788918446.720288:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788918446.720310:0:8366:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d83100 x1875816865617664/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788918462 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918446.720320:0:8366:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788918446.720327:0:8366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d83100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8366:1875816865617664:0@lo:5: 00000004:00080000:0.0:1788918446.720339:0:8366:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788918446.720375:0:8366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d83100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8366:1875816865617792:0@lo:700: 00000100:00100000:0.0:1788918446.720404:0:8366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918446.720426:0:8366:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788918446.720445:0:6918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865617792 00000100:00100000:1.0:1788918446.720450:0:6918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865617792 00000100:00100000:1.0:1788918446.720486:0:6918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788918446.720494:0:6918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8366:x1875816865617792:12345-0@lo:700: 00000100:00100000:1.0:1788918446.720523:0:6918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6918:1875816865617920:0@lo:700: 00000100:00100000:1.0:1788918446.720550:0:6918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918446.720610:0:6918:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc7050d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788918446.720636:0:5931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865617920 00000100:00100000:3.0:1788918446.720639:0:5931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865617920 00000100:00100000:3.0:1788918446.720665:0:5931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788918446.720671:0:5931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6918:x1875816865617920:12345-0@lo:700: 40000000:02000000:3.0:1788918446.723683:0:5931:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788918446.726366:0:5931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6918:x1875816865617920:12345-0@lo:700: Request processed in 5689us (5809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918446.726378:0:5931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788918446.726485:0:6918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94fffc877480 x1875816865617920/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788918462 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918446.726498:0:6918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6918:1875816865617920:0@lo:700: 40000000:02000000:1.0:1788918446.726509:0:6918:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1788918446.739224:0:6918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8366:x1875816865617792:12345-0@lo:700: Request processed in 18721us (18809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918446.739238:0:6918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788918446.739325:0:8366:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d83100 x1875816865617792/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788918462 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918446.739340:0:8366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d83100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8366:1875816865617792:0@lo:700: 00000004:02000040:2.0:1788918446.742167:0:8366:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788918446.744108:0:8366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8366:1875816865618048:0@lo:5: 00000100:00100000:2.0:1788918446.744173:0:8366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918446.744220:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865618048 00000100:00100000:3.0:1788918446.744229:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865618048 00000100:00100000:3.0:1788918446.744288:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788918446.744297:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8366:x1875816865618048:12345-0@lo:5: 00000100:00100000:2.0:1788918446.746186:0:8366:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fb300 going to sleep for 11 seconds 00002000:00080000:3.0:1788918446.748241:0:6909:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788918446.748264:0:6909:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788918446.758175:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8366:x1875816865618048:12345-0@lo:5: Request processed in 13869us (13992us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788918446.758190:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788918446.759070:0:8366:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d98700 x1875816865618048/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788918462 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918446.759089:0:8366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8366:1875816865618048:0@lo:5: 00000004:00080000:2.0:1788918446.759104:0:8366:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000020:00000004:1.0:1788918447.071804:0:8397:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788918447.071990:0:8397:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788918447.191173:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865618176:0@lo:13: 00000100:00100000:3.0:1788918447.191287:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918447.191383:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865618176 00000100:00100000:3.0:1788918447.191392:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865618176 00000100:00100000:3.0:1788918447.191451:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788918447.191463:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865618176:12345-0@lo:13: 00002000:00000024:3.0:1788918447.191503:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918447.191553:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865618176:12345-0@lo:13: Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918447.191560:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788918447.191612:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffc70c0000 x1875816865618176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918447.191634:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865618176:0@lo:13: 00010000:00010000:2.0:1788918447.639909:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788918447.938880:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788918448.664419:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918449.686258:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788918449.889259:0:8498:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788918449.889487:0:8498:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788918450.710487:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788918450.894980:0:8546:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788918450.894990:0:8546:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1788918451.375802:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918451.376191:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855109760 00000100:00100000:2.0:1788918451.376208:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855109760 00000100:00100000:2.0:1788918451.376277:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 109 00000100:00100000:2.0:1788918451.376288:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1875816855109760:12345-192.168.202.49@tcp:250: 00010000:00080000:2.0:1788918451.376323:0:5917:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 89208175-5136-4226-96dc-dc05cbfafbe9@192.168.202.49@tcp t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:2.0:1788918451.376361:0:5917:0:(genops.c:1385:class_connect()) connect: client 89208175-5136-4226-96dc-dc05cbfafbe9, cookie 0x2811b8b2b0ac8c80 00000100:00080000:2.0:1788918451.376688:0:5917:0:(import.c:65:import_set_state_nolock()) ffff94ffff791000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788918451.376818:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+5:2348:x1875816855109760:12345-192.168.202.49@tcp:250: Request processed in 530us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918451.376827:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 109 00000100:00100000:3.0:1788918451.392300:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918451.392380:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855109888 00000100:00100000:2.0:1788918451.392393:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855109888 00000100:00100000:2.0:1788918451.392501:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 110 00000100:00100000:2.0:1788918451.392513:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+5:5421:x1875816855109888:12345-192.168.202.49@tcp:101: 00010000:00010000:2.0:1788918451.392535:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918451.392556:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8c87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f0273 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918451.392610:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0273 expref: 6 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918451.392622:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0273 expref: 6 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918451.392635:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd400, rc 0) 00000100:00100000:2.0:1788918451.392703:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+6:5421:x1875816855109888:12345-192.168.202.49@tcp:101: Request processed in 192us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918451.392711:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 110 00000100:00100000:3.0:1788918451.394636:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918451.395492:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855110016 00000100:00100000:0.0:1788918451.395505:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855110016 00000100:00100000:0.0:1788918451.395568:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 111 00000100:00100000:0.0:1788918451.395580:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+6:5421:x1875816855110016:12345-192.168.202.49@tcp:501: 00000100:00100000:0.0:1788918451.395708:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+6:5421:x1875816855110016:12345-192.168.202.49@tcp:501: Request processed in 131us (1081us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788918451.395717:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 111 00000100:00100000:3.0:1788918451.404812:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918451.404938:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855110144 00000100:00100000:0.0:1788918451.404955:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855110144 00000100:00100000:0.0:1788918451.405130:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 112 00000100:00100000:0.0:1788918451.405142:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+6:5421:x1875816855110144:12345-192.168.202.49@tcp:101: 00010000:00010000:0.0:1788918451.405175:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918451.405198:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8c8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f027a expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918451.405237:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f027a expref: 7 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918451.405251:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f027a expref: 7 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918451.405263:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691f200, rc 0) 00000100:00100000:0.0:1788918451.405337:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+7:5421:x1875816855110144:12345-192.168.202.49@tcp:101: Request processed in 196us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918451.405345:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 112 00000100:00100000:3.0:1788918451.413103:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918451.413204:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855110272 00000100:00100000:2.0:1788918451.413221:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855110272 00000100:00100000:2.0:1788918451.413290:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 113 00000100:00100000:2.0:1788918451.413300:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+7:5421:x1875816855110272:12345-192.168.202.49@tcp:501: 00000100:00100000:2.0:1788918451.413675:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+8:5421:x1875816855110272:12345-192.168.202.49@tcp:501: Request processed in 374us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918451.413684:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 113 00000100:00100000:3.0:1788918451.419647:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918451.420253:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855110400 00000100:00100000:2.0:1788918451.420267:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855110400 00000100:00100000:2.0:1788918451.420425:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 114 00000100:00100000:2.0:1788918451.420437:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+8:5421:x1875816855110400:12345-192.168.202.49@tcp:503: 00000100:00100000:2.0:1788918451.420628:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+8:5421:x1875816855110400:12345-192.168.202.49@tcp:503: Request processed in 192us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918451.420637:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 114 00000100:00100000:3.0:1788918451.423606:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918451.424449:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855110528 00000100:00100000:0.0:1788918451.424471:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855110528 00000100:00100000:0.0:1788918451.424533:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 115 00000100:00100000:0.0:1788918451.424545:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+8:5439:x1875816855110528:12345-192.168.202.49@tcp:502: 00000100:00100000:0.0:1788918451.424982:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+8:5439:x1875816855110528:12345-192.168.202.49@tcp:502: Request processed in 438us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918451.424990:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 115 00000100:00100000:0.0:1788918451.457439:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918451.457545:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855110656 00000100:00100000:2.0:1788918451.457576:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855110656 00000100:00100000:2.0:1788918451.457701:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 116 00000100:00100000:2.0:1788918451.457713:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+8:5439:x1875816855110656:12345-192.168.202.49@tcp:502: 00000100:00100000:2.0:1788918451.457886:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+8:5439:x1875816855110656:12345-192.168.202.49@tcp:502: Request processed in 175us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918451.457895:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 116 00000100:00100000:3.0:1788918451.471144:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918451.471226:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855110784 00000100:00100000:0.0:1788918451.471244:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855110784 00000100:00100000:0.0:1788918451.471326:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 117 00000100:00100000:0.0:1788918451.471339:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+8:5421:x1875816855110784:12345-192.168.202.49@tcp:101: 00010000:00010000:0.0:1788918451.471360:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918451.471395:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0ac8c95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f02a4 expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918451.471432:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0ac8c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02a4 expref: 9 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918451.471446:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0ac8c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02a4 expref: 9 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918451.471457:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691ea00, rc 0) 00000100:00100000:0.0:1788918451.471701:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+9:5421:x1875816855110784:12345-192.168.202.49@tcp:101: Request processed in 364us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918451.471709:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 117 00000100:00100000:0.0:1788918451.478786:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918451.478878:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855110912 00000100:00100000:2.0:1788918451.478892:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855110912 00000100:00100000:2.0:1788918451.479081:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 118 00000100:00100000:2.0:1788918451.479093:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+9:5421:x1875816855110912:12345-192.168.202.49@tcp:256: 20000000:01000000:2.0:1788918451.479128:0:5917:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788918451.479155:0:5917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788918451.479159:0:5917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788918451.479163:0:5917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788918451.479166:0:5917:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788918451.485446:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+9:5421:x1875816855110912:12345-192.168.202.49@tcp:256: Request processed in 6339us (6752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918451.485462:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 118 00000100:00100000:1.0:1788918451.488139:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918451.488274:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855111040 00000100:00100000:0.0:1788918451.488282:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855111040 00000100:00100000:1.0:1788918451.488424:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 119 00000100:00100000:1.0:1788918451.488433:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+9:5421:x1875816855111040:12345-192.168.202.49@tcp:101: 00010000:00010000:1.0:1788918451.488446:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918451.488463:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8c9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f02ab expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918451.488491:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ab expref: 10 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918451.488504:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ab expref: 10 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918451.488511:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1493400, rc 0) 00000100:00100000:1.0:1788918451.488557:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:5421:x1875816855111040:12345-192.168.202.49@tcp:101: Request processed in 126us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918451.488562:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 119 00000100:00100000:0.0:1788918451.490339:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918451.490431:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855111168 00000100:00100000:2.0:1788918451.490444:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855111168 00000100:00100000:2.0:1788918451.490515:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00100000:2.0:1788918451.490526:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+10:5421:x1875816855111168:12345-192.168.202.49@tcp:501: 00000100:00100000:2.0:1788918451.490836:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+10:5421:x1875816855111168:12345-192.168.202.49@tcp:501: Request processed in 310us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918451.490845:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00100000:0.0:1788918451.491975:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918451.492066:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855111296 00000100:00100000:1.0:1788918451.492074:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855111296 00000100:00100000:1.0:1788918451.492124:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 121 00000100:00100000:1.0:1788918451.492133:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:5421:x1875816855111296:12345-192.168.202.49@tcp:503: 00000100:00100000:1.0:1788918451.492400:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:5421:x1875816855111296:12345-192.168.202.49@tcp:503: Request processed in 267us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918451.492408:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 121 00000100:00100000:1.0:1788918451.497898:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918451.498222:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855111424 00000100:00100000:2.0:1788918451.498236:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855111424 00000100:00100000:2.0:1788918451.498352:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 122 00000100:00100000:2.0:1788918451.498364:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+10:5444:x1875816855111424:12345-192.168.202.49@tcp:502: 00000100:00100000:2.0:1788918451.498537:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+10:5444:x1875816855111424:12345-192.168.202.49@tcp:502: Request processed in 175us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918451.498545:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 122 00000100:00100000:0.0:1788918451.501578:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918451.501650:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855111552 00000100:00100000:1.0:1788918451.501894:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855111552 00000100:00100000:1.0:1788918451.501969:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 123 00000100:00100000:1.0:1788918451.501981:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:5444:x1875816855111552:12345-192.168.202.49@tcp:502: 00000100:00100000:1.0:1788918451.502301:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:5444:x1875816855111552:12345-192.168.202.49@tcp:502: Request processed in 321us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918451.502309:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 123 00000100:00100000:0.0:1788918451.507327:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918451.507667:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855111680 00000100:00100000:3.0:1788918451.507689:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855111680 00000100:00100000:3.0:1788918451.507745:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:3.0:1788918451.507755:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1875816855111680:12345-192.168.202.49@tcp:38: 00010000:00080000:3.0:1788918451.507792:0:5924:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:3.0:1788918451.507851:0:5924:0:(genops.c:1385:class_connect()) connect: client 9b921db9-4859-438b-976e-b950f67eace4, cookie 0x2811b8b2b0ac8ca3 00000004:00100000:3.0:1788918451.507881:0:5924:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788918451.507888:0:5924:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788918451.536468:0:5924:0:(import.c:65:import_set_state_nolock()) ffff94ffff795800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788918451.536575:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2348:x1875816855111680:12345-192.168.202.49@tcp:38: Request processed in 28819us (29260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918451.536588:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00010000:00010000:2.0:1788918451.734552:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918451.798511:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788918451.798659:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865618432:0@lo:13: 00000100:00100000:2.0:1788918451.798756:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918451.798921:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788918451.798937:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865618560:0@lo:400: 00000100:00100000:2.0:1788918451.798965:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918451.799003:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865618560 00000100:00100000:2.0:1788918451.799011:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865618560 00000100:00100000:2.0:1788918451.799079:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788918451.799089:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865618560:12345-0@lo:400: 00000100:00100000:2.0:1788918451.799153:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865618560:12345-0@lo:400: Request processed in 65us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918451.799161:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788918451.799215:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d81180 x1875816865618560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918451.799232:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865618560:0@lo:400: 00000100:00100000:3.0:1788918451.800156:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788918451.800173:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865618688:0@lo:400: 00000100:00100000:3.0:1788918451.800238:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918451.800285:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865618432 00000100:00100000:3.0:1788918451.800290:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865618432 00000100:00100000:3.0:1788918451.800335:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788918451.800343:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865618432:12345-0@lo:13: 00002000:00000024:3.0:1788918451.800374:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918451.800413:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865618432:12345-0@lo:13: Request processed in 71us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918451.800420:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788918451.800437:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788918451.800466:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d9aa00 x1875816865618432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918451.800478:0:3419:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788918451.800512:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865618432:0@lo:13: 00000100:00100000:2.0:1788918451.803643:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865618688 00000100:00100000:2.0:1788918451.803689:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865618688 00000100:00100000:2.0:1788918451.803780:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788918451.803795:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865618688:12345-0@lo:400: 00000100:00100000:2.0:1788918451.803913:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865618688:12345-0@lo:400: Request processed in 124us (3673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918451.803920:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788918451.803979:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d81880 x1875816865618688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918451.803996:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865618688:0@lo:400: 00000100:00080000:3.0:1788918451.804636:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918451.804864:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865618304:0@lo:400: 00000100:00100000:1.0:1788918451.805429:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918451.805536:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865618304 00000100:00100000:2.0:1788918451.805543:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865618304 00000100:00100000:2.0:1788918451.805622:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788918451.805631:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865618304:12345-0@lo:400: 00000100:00100000:2.0:1788918451.805692:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865618304:12345-0@lo:400: Request processed in 62us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918451.805697:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788918451.805761:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865618304:0@lo:400: 00000100:00100000:0.0:1788918451.807328:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788918451.807346:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865618944:0@lo:400: 00000100:00100000:0.0:1788918451.807406:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918451.807448:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865618944 00000100:00100000:0.0:1788918451.807454:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865618944 00000100:00100000:0.0:1788918451.807502:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788918451.807509:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865618944:12345-0@lo:400: 00000100:00100000:0.0:1788918451.807550:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865618944:12345-0@lo:400: Request processed in 42us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918451.807573:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788918451.807609:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d81880 x1875816865618944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918451.807623:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865618944:0@lo:400: 00000100:00080000:0.0:1788918451.807639:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918451.807649:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865618816:0@lo:400: 00000100:00100000:0.0:1788918451.807688:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918451.808087:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865618816 00000100:00100000:1.0:1788918451.808091:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865618816 00000100:00100000:1.0:1788918451.808146:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788918451.808154:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865618816:12345-0@lo:400: 00000100:00100000:1.0:1788918451.808208:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865618816:12345-0@lo:400: Request processed in 44us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918451.808215:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788918451.808246:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d80e00 x1875816865618816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918451.808256:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865618816:0@lo:400: 00000100:00080000:0.0:1788918451.810258:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788918452.310373:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865619072:0@lo:13: 00000100:00100000:0.0:1788918452.310488:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918452.310647:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865619072 00000100:00100000:2.0:1788918452.310669:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865619072 00000100:00100000:2.0:1788918452.310741:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788918452.310753:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865619072:12345-0@lo:13: 00002000:00000024:2.0:1788918452.310790:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918452.310851:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865619072:12345-0@lo:13: Request processed in 101us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918452.310859:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788918452.310953:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffc70c2d80 x1875816865619072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918452.310977:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865619072:0@lo:13: 00000100:00100000:3.0:1788918452.544388:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918452.546488:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918452.557706:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855111808 00000100:00100000:0.0:1788918452.557727:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855111808 00000100:00100000:0.0:1788918452.557835:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855111936 00000100:00100000:0.0:1788918452.557839:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855111936 00000100:00100000:0.0:1788918452.557864:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:0.0:1788918452.557874:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+7:0:x1875816855111808:12345-192.168.202.49@tcp:41: 00000004:00000024:0.0:1788918452.557949:0:5926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00080000:3.0:1788918452.558049:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918452.558307:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+7:0:x1875816855111808:12345-192.168.202.49@tcp:41: Request processed in 433us (13933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918452.558315:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:0.0:1788918452.558337:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:0.0:1788918452.558344:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:5421:x1875816855111936:12345-192.168.202.49@tcp:41: 00000004:00000024:0.0:1788918452.558356:0:5926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:0.0:1788918452.558377:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:5421:x1875816855111936:12345-192.168.202.49@tcp:41: Request processed in 34us (11902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918452.558839:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:3.0:1788918452.567828:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918452.568205:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855112064 00000100:00100000:1.0:1788918452.568218:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855112064 00000100:00100000:1.0:1788918452.568292:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:1.0:1788918452.568305:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+6:5421:x1875816855112064:12345-192.168.202.49@tcp:40: 00000100:00100000:1.0:1788918452.568711:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+6:5421:x1875816855112064:12345-192.168.202.49@tcp:40: Request processed in 408us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918452.568738:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:1.0:1788918452.579321:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918452.580248:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855112192 00000100:00100000:0.0:1788918452.580263:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855112192 00000100:00100000:0.0:1788918452.580330:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:0.0:1788918452.580340:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875816855112192:12345-192.168.202.49@tcp:8: 00010000:00080000:0.0:1788918452.580383:0:7258:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:0.0:1788918452.580435:0:7258:0:(genops.c:1385:class_connect()) connect: client 9b921db9-4859-438b-976e-b950f67eace4, cookie 0x2811b8b2b0ac8caa 00002000:00100000:0.0:1788918452.580450:0:7258:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9b921db9-4859-438b-976e-b950f67eace4/ffff94ffd043f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788918452.580462:0:7258:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788918452.580671:0:7258:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788918452.580707:0:7258:0:(import.c:65:import_set_state_nolock()) ffff94ffd0439000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788918452.583160:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+6:2348:x1875816855112192:12345-192.168.202.49@tcp:8: Request processed in 2806us (3839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918452.583177:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:3.0:1788918452.587636:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918452.591782:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918452.592064:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855112320 00000100:00100000:0.0:1788918452.592076:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855112320 00000100:00100000:0.0:1788918452.592143:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:0.0:1788918452.592154:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875816855112320:12345-192.168.202.49@tcp:8: 00010000:00080000:0.0:1788918452.592189:0:6912:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:0.0:1788918452.592224:0:6912:0:(genops.c:1385:class_connect()) connect: client 9b921db9-4859-438b-976e-b950f67eace4, cookie 0x2811b8b2b0ac8cb1 00002000:00100000:0.0:1788918452.592236:0:6912:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9b921db9-4859-438b-976e-b950f67eace4/ffff94ffd043c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788918452.592246:0:6912:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788918452.592336:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855112448 00000100:00100000:2.0:1788918452.592351:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855112448 00000100:00100000:2.0:1788918452.592427:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:2.0:1788918452.592457:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+6:5421:x1875816855112448:12345-192.168.202.49@tcp:33: 00002000:00080000:0.0:1788918452.592480:0:6912:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788918452.592513:0:6912:0:(import.c:65:import_set_state_nolock()) ffff94ffd043b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788918452.592596:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2348:x1875816855112320:12345-192.168.202.49@tcp:8: Request processed in 442us (4970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918452.592605:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:3.0:1788918452.598432:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918452.600089:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855112576 00000100:00100000:1.0:1788918452.600103:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855112576 00000100:00100000:1.0:1788918452.600222:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 125 00000100:00100000:1.0:1788918452.600233:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:2352:x1875816855112576:12345-192.168.202.49@tcp:400: 00000100:00100000:1.0:1788918452.600309:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:2352:x1875816855112576:12345-192.168.202.49@tcp:400: Request processed in 77us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918452.600316:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 125 00000004:00080000:3.0:1788918452.609007:0:5927:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 16449us 00000004:00200000:3.0:1788918452.612813:0:5927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788918452.612933:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+6:5421:x1875816855112448:12345-192.168.202.49@tcp:33: Request processed in 20463us (21158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918452.612947:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00010000:00010000:3.0:1788918452.762277:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918452.834805:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918452.834991:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855112704 00000100:00100000:2.0:1788918452.835001:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855112704 00000100:00100000:2.0:1788918452.835094:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:2.0:1788918452.835104:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+6:5461:x1875816855112704:12345-192.168.202.49@tcp:101: 00010000:00010000:2.0:1788918452.835123:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918452.835199:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac8cb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f02d5 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918452.835265:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc000/0x2811b8b2b0ac8cbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918452.835279:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc000/0x2811b8b2b0ac8cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918452.835294:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc000/0x2811b8b2b0ac8cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918452.835338:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788918452.835341:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918452.835357:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc000/0x2811b8b2b0ac8cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918452.835382:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac8cb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02d5 expref: 8 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918452.835401:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc000/0x2811b8b2b0ac8cbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02d5 expref: 7 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918452.835411:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ffff5d1900) 00010000:00010000:2.0:1788918452.835420:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788918452.835424:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dc000, rc 0) 00000100:00100000:2.0:1788918452.835558:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+7:5461:x1875816855112704:12345-192.168.202.49@tcp:101: Request processed in 454us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918452.835566:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00010000:00010000:2.0:1788918453.783579:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918454.708147:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918454.708308:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855112832 00000100:00100000:2.0:1788918454.708322:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855112832 00000100:00080000:3.0:1788918454.708433:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918454.708466:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:2.0:1788918454.708476:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+7:5514:x1875816855112832:12345-192.168.202.49@tcp:41: 00000004:00000024:2.0:1788918454.708521:0:5926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1788918454.708592:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+7:5514:x1875816855112832:12345-192.168.202.49@tcp:41: Request processed in 118us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918454.708598:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:0.0:1788918454.710707:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918454.710835:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855112960 00000100:00100000:2.0:1788918454.710843:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855112960 00000100:00080000:3.0:1788918454.710934:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788918454.710982:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:2.0:1788918454.710992:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9b921db9-4859-438b-976e-b950f67eace4+6:5514:x1875816855112960:12345-192.168.202.49@tcp:13: 00002000:00000024:2.0:1788918454.711068:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918454.711133:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9b921db9-4859-438b-976e-b950f67eace4+6:5514:x1875816855112960:12345-192.168.202.49@tcp:13: Request processed in 142us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918454.711142:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:3.0:1788918454.712498:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918454.712551:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855113088 00000100:00100000:0.0:1788918454.712560:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855113088 00000100:00080000:3.0:1788918454.712603:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788918454.712614:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:0.0:1788918454.712625:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9b921db9-4859-438b-976e-b950f67eace4+6:5514:x1875816855113088:12345-192.168.202.49@tcp:13: 00002000:00000024:0.0:1788918454.712787:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918454.712888:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9b921db9-4859-438b-976e-b950f67eace4+6:5514:x1875816855113088:12345-192.168.202.49@tcp:13: Request processed in 265us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918454.712894:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00010000:00010000:3.0:1788918454.806399:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918455.831353:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788918456.794633:0:8644:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788918456.854364:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918456.921447:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865619584:0@lo:400: 00000100:00100000:3.0:1788918456.921519:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918456.921593:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788918456.921600:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865619456:0@lo:400: 00000100:00100000:3.0:1788918456.921623:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918456.921652:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865619968:0@lo:400: 00000100:00100000:3.0:1788918456.921675:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918456.922133:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865619584 00000100:00100000:3.0:1788918456.922142:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865619584 00000100:00100000:3.0:1788918456.922196:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865619456 00000100:00100000:3.0:1788918456.922200:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865619456 00000100:00100000:3.0:1788918456.922217:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788918456.922226:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865619584:12345-0@lo:400: 00000100:00100000:3.0:1788918456.922283:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865619584:12345-0@lo:400: Request processed in 57us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918456.922290:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788918456.922307:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788918456.922313:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865619456:12345-0@lo:400: 00000100:00100000:3.0:1788918456.922339:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865619456:12345-0@lo:400: Request processed in 26us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918456.922345:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788918456.922362:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865619968 00000100:00100000:3.0:1788918456.922365:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865619968 00000100:00100000:3.0:1788918456.922392:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788918456.922399:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865619968:12345-0@lo:400: 00000100:00100000:3.0:1788918456.922426:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865619968:12345-0@lo:400: Request processed in 28us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918456.922431:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788918456.922446:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788918456.922451:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918456.922489:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865619456:0@lo:400: 00010000:00080000:3.0:1788918456.922503:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94fff48a6d80 x1875816865619968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918456.922513:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865619968:0@lo:400: 00000100:00100000:3.0:1788918456.922522:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865619584:0@lo:400: 00000100:00100000:1.0:1788918456.924543:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865619200:0@lo:13: 00000100:00100000:1.0:1788918456.924610:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918456.925573:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865619712:0@lo:400: 00000100:00100000:1.0:1788918456.925628:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918456.925668:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788918456.925675:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865619328:0@lo:400: 00000100:00100000:1.0:1788918456.926921:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918456.926960:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865619840:0@lo:400: 00000100:00100000:1.0:1788918456.927000:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1788918456.927288:0:7980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00000100:00100000:1.0:1788918456.928146:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865619200 00000100:00100000:1.0:1788918456.928157:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865619200 00000100:00100000:1.0:1788918456.928210:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788918456.928221:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865619200:12345-0@lo:13: 00002000:00000024:1.0:1788918456.928255:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918456.928313:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865619200:12345-0@lo:13: Request processed in 94us (3703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918456.928333:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788918456.928359:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865619712 00000100:00100000:1.0:1788918456.928364:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865619712 00000100:00100000:1.0:1788918456.928399:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788918456.928407:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865619712:12345-0@lo:400: 00000100:00100000:1.0:1788918456.928438:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865619712:12345-0@lo:400: Request processed in 33us (2811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918456.928444:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788918456.928483:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94fff48a7b80 x1875816865619200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918456.928503:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865619200:0@lo:13: 00010000:00080000:1.0:1788918456.928515:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94fff48a6300 x1875816865619712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918456.928523:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865619712:0@lo:400: 00000100:00080000:1.0:1788918456.928550:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918456.928561:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865619840 00000100:00100000:1.0:1788918456.928565:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865619840 00000100:00100000:1.0:1788918456.928598:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788918456.928604:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865619840:12345-0@lo:400: 00000100:00100000:1.0:1788918456.928637:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865619840:12345-0@lo:400: Request processed in 33us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918456.928642:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788918456.928665:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865619840:0@lo:400: 00000100:00080000:1.0:1788918456.928680:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918456.929638:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865619328 00000100:00100000:2.0:1788918456.929645:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865619328 00000100:00100000:2.0:1788918456.930125:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788918456.930138:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865619328:12345-0@lo:400: 00000100:00100000:2.0:1788918456.930217:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865619328:12345-0@lo:400: Request processed in 83us (3298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918456.930225:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788918456.930814:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865619328:0@lo:400: 00000100:00100000:2.0:1788918457.430466:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788918457.430493:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865620096:0@lo:13: 00000100:00100000:2.0:1788918457.430568:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918457.430680:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865620096 00000100:00100000:3.0:1788918457.430689:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865620096 00000100:00100000:3.0:1788918457.430738:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788918457.430748:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865620096:12345-0@lo:13: 00002000:00000024:3.0:1788918457.430775:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918457.430836:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865620096:12345-0@lo:13: Request processed in 90us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918457.430844:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788918457.430896:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94fff48a4380 x1875816865620096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918457.430915:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865620096:0@lo:13: 00000001:00100000:1.0:1788918457.433229:0:5903:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00010000:00010000:2.0:1788918457.884434:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918458.029101:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918458.029147:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918458.029192:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918458.029227:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918458.029262:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855113344 00000100:00100000:3.0:1788918458.029286:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855113344 00000100:00100000:3.0:1788918458.029364:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:3.0:1788918458.029378:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855113344:12345-192.168.202.49@tcp:400: 00000100:00100000:3.0:1788918458.029476:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855113344:12345-192.168.202.49@tcp:400: Request processed in 102us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918458.029502:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:3.0:1788918458.029531:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855113472 00000100:00100000:3.0:1788918458.029535:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855113472 00000100:00100000:3.0:1788918458.029562:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855113600 00000100:00100000:3.0:1788918458.029565:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855113600 00000100:00100000:3.0:1788918458.029588:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:3.0:1788918458.029598:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855113472:12345-192.168.202.49@tcp:400: 00000100:00100000:3.0:1788918458.029627:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855113472:12345-192.168.202.49@tcp:400: Request processed in 32us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918458.029633:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:3.0:1788918458.029644:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:3.0:1788918458.029649:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2351:x1875816855113600:12345-192.168.202.49@tcp:400: 00000100:00100000:3.0:1788918458.029696:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2351:x1875816855113600:12345-192.168.202.49@tcp:400: Request processed in 46us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918458.029703:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:1.0:1788918458.029813:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855113216 00000100:00100000:1.0:1788918458.029818:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855113216 00000100:00100000:1.0:1788918458.029853:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 127 00000100:00100000:1.0:1788918458.029860:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:2351:x1875816855113216:12345-192.168.202.49@tcp:400: 00000100:00100000:1.0:1788918458.029898:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:2351:x1875816855113216:12345-192.168.202.49@tcp:400: Request processed in 38us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918458.029904:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 127 00000100:00080000:1.0:1788918458.029937:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788918458.029941:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788918458.029943:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1788918458.457252:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00010000:00010000:1.0:1788918458.903868:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788918459.669648:0:8791:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb3573440 20000000:00000080:2.0:1788918459.669663:0:8791:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94ffff5cd000 uarg=0000000000000000 20000000:01000000:2.0:1788918459.669695:0:8791:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788918459.669697:0:8791:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788918459.669699:0:8791:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788918459.669703:0:8791:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788918459.669706:0:8791:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788918459.669748:0:8791:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788918459.669749:0:8791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788918459.671572:0:8792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788918459.671785:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788918459.671805:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788918459.671813:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788918459.671819:0:8791:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788918459.671821:0:8791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788918459.672507:0:8793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788918459.672826:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788918459.672863:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788918459.672882:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788918459.672894:0:8791:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788918459.672896:0:8791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788918459.673572:0:8794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788918459.673776:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788918459.673790:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788918459.673798:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788918459.673804:0:8791:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788918459.673806:0:8791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788918459.677514:0:8795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788918459.677897:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788918459.677925:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788918459.677939:0:8791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1788918459.677952:0:8791:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788918459.677972:0:8791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.677988:0:8791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc0030000/0x2811b8b2b0ac8bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8bbc expref: 18 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.677996:0:8791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8be6 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.678003:0:8791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c10 expref: 18 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.678057:0:8791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c1e expref: 18 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.678064:0:8791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac8c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c2c expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.678071:0:8791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac8c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c48 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.678077:0:8791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c72 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.678087:0:8791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8c87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0273 expref: 9 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.678094:0:8791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f027a expref: 9 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.678102:0:8791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.678141:0:8791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f027a expref: 9 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.678156:0:8791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8c8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f027a expref: 9 pid: 5916 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.678170:0:8791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620224:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918459.679110:0:8791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0273 expref: 9 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.679129:0:8791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8c87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0273 expref: 9 pid: 5918 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.679140:0:8791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620352:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918459.679176:0:8791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8c72 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.679184:0:8791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8c79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c72 expref: 18 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.679256:0:8791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620480:0@lo:104: 00000100:00100000:0.0:1788918459.679432:0:8791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788918459.679515:0:8791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac8c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8c48 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.679525:0:8791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac8c4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c48 expref: 18 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.679533:0:8791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620608:0@lo:104: 00000100:00100000:0.0:1788918459.679559:0:8791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788918459.679744:0:8791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac8c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8c2c expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.679754:0:8791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac8c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c2c expref: 18 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.679762:0:8791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620736:0@lo:104: 00010000:00010000:0.0:1788918459.679796:0:8791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8c1e expref: 18 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.679810:0:8791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8c25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c1e expref: 18 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.679820:0:8791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620864:0@lo:104: 00010000:00010000:0.0:1788918459.679849:0:8791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8c10 expref: 18 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.679870:0:8791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8c17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c10 expref: 18 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.679879:0:8791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620992:0@lo:104: 00010000:00010000:0.0:1788918459.679905:0:8791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8be6 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.679914:0:8791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8bed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8be6 expref: 18 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.679921:0:8791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865621120:0@lo:104: 00010000:00010000:0.0:1788918459.679942:0:8791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc0030000/0x2811b8b2b0ac8bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8bbc expref: 18 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.679950:0:8791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc0030000/0x2811b8b2b0ac8bc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8bbc expref: 18 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.679957:0:8791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865621248:0@lo:104: 00000100:00100000:0.0:1788918459.679973:0:8791:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918459.680184:0:5907:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788918459.680213:0:5907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918459.680225:0:5907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918459.680232:0:5907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918459.680239:0:5907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918459.680247:0:5907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918459.680256:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865620480 00000100:00100000:2.0:1788918459.680271:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865620480 00000100:00100000:2.0:1788918459.680325:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865620608 00000100:00100000:2.0:1788918459.680329:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865620608 00000100:00100000:2.0:1788918459.680341:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865620736 00000100:00100000:2.0:1788918459.680343:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865620736 00000100:00100000:2.0:1788918459.680351:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865620864 00000100:00100000:2.0:1788918459.680354:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865620864 00000100:00100000:2.0:1788918459.680363:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865620992 00000100:00100000:2.0:1788918459.680365:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865620992 00000100:00100000:2.0:1788918459.680373:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865621120 00000100:00100000:2.0:1788918459.680375:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865621120 00000100:00100000:2.0:1788918459.680383:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865621248 00000100:00100000:2.0:1788918459.680385:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865621248 00000100:00100000:2.0:1788918459.680395:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788918459.680403:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+9:8791:x1875816865620480:12345-0@lo:104: 00010000:00010000:2.0:1788918459.680416:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8c79 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918459.680471:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788918459.680477:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+9:8791:x1875816865620480:12345-0@lo:104: Request processed in 76us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918459.680484:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788918459.680502:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788918459.680508:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff689fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+8:8791:x1875816865620608:12345-0@lo:104: 00010000:00010000:2.0:1788918459.680515:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8c4f expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918459.680543:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788918459.680548:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff689fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+8:8791:x1875816865620608:12345-0@lo:104: Request processed in 41us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918459.680553:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788918459.680587:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788918459.680593:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+7:8791:x1875816865620736:12345-0@lo:104: 00010000:00010000:2.0:1788918459.680599:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8c33 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918459.680624:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788918459.680629:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+7:8791:x1875816865620736:12345-0@lo:104: Request processed in 38us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918459.680634:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788918459.680646:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788918459.680651:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+6:8791:x1875816865620864:12345-0@lo:104: 00010000:00010000:2.0:1788918459.680657:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8c25 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918459.680696:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788918459.680700:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+6:8791:x1875816865620864:12345-0@lo:104: Request processed in 50us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918459.680706:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788918459.680717:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788918459.680722:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+5:8791:x1875816865620992:12345-0@lo:104: 00010000:00010000:2.0:1788918459.680729:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8c17 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918459.680753:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788918459.680757:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+5:8791:x1875816865620992:12345-0@lo:104: Request processed in 36us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918459.680762:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788918459.680779:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788918459.680784:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+4:8791:x1875816865621120:12345-0@lo:104: 00010000:00010000:2.0:1788918459.680791:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8bed expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918459.680815:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788918459.680819:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+4:8791:x1875816865621120:12345-0@lo:104: Request processed in 36us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918459.680824:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788918459.680834:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788918459.680839:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:8791:x1875816865621248:12345-0@lo:104: 00010000:00010000:2.0:1788918459.680846:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8bc3 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918459.680880:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788918459.680884:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:8791:x1875816865621248:12345-0@lo:104: Request processed in 46us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918459.680890:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788918459.681123:0:8791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620480:0@lo:104: 00000100:00100000:0.0:1788918459.681132:0:8791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620608:0@lo:104: 00000100:00100000:0.0:1788918459.681151:0:8791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620736:0@lo:104: 00000100:00100000:0.0:1788918459.681156:0:8791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620864:0@lo:104: 00000100:00100000:0.0:1788918459.681162:0:8791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620992:0@lo:104: 00000100:00100000:0.0:1788918459.681168:0:8791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865621120:0@lo:104: 00000100:00100000:0.0:1788918459.681174:0:8791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865621248:0@lo:104: 00000100:00100000:3.0:1788918459.681455:0:5908:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:1.0:1788918459.682041:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788918459.682060:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8c79 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682070:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4600 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918459.682074:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8c79 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682084:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8c79 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918459.682098:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8c79 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918459.682105:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788918459.682158:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c79 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682172:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918459.682207:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c79 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682215:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4600/0x2811b8b2b0ac8c72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c79 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682229:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788918459.682233:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8c4f expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682239:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc200 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918459.682242:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8c4f expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682248:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8c4f expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918459.682255:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8c4f expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918459.682261:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788918459.682263:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788918459.682285:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c4f expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918459.682292:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865621376:0@lo:103: 00010000:00010000:1.0:1788918459.682294:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918459.682301:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c4f expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682311:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94fff48dc200/0x2811b8b2b0ac8c48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c4f expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682328:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788918459.682332:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8c33 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682338:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1492000 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918459.682341:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8c33 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682348:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8c33 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918459.682354:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8c33 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918459.682359:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788918459.682374:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c33 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682381:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918459.682397:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c33 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682404:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8c2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c33 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682414:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788918459.682418:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8c25 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682435:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1493e00 already unused, calling callback (ffffffffc12e1c20) 00000100:00100000:3.0:1788918459.682436:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1788918459.682441:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8c25 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682451:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8c25 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918459.682457:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8c25 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918459.682462:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788918459.682518:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865621504:0@lo:103: 00000100:00100000:0.0:1788918459.682705:0:8791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620224:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918459.682715:0:8791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8791:1875816865620352:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918459.682749:0:8791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682889:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c25 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682896:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918459.682903:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c25 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682911:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1493e00/0x2811b8b2b0ac8c1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c25 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918459.682919:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788918459.682928:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788918459.682932:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8c17 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682938:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031400 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918459.682940:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8c17 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682958:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8c17 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918459.682964:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8c17 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918459.682969:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788918459.682988:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c17 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.682994:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788918459.683014:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:1.0:1788918459.683092:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c17 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683101:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc0031400/0x2811b8b2b0ac8c10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8c17 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683111:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788918459.683115:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8bed expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683121:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1529600 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918459.683125:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8bed expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683142:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8bed expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918459.683149:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8bed expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918459.683161:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788918459.683179:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8bed expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683185:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918459.683192:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8bed expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683198:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1529600/0x2811b8b2b0ac8be6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8bed expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683211:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918459.683214:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8bc3 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683221:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1528400 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918459.683224:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8bc3 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683231:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8bc3 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918459.683235:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865621888:0@lo:103: 10000000:00010000:1.0:1788918459.683243:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8bc3 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918459.683250:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788918459.683268:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8bc3 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683274:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918459.683286:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8bc3 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683292:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1528400/0x2811b8b2b0ac8bbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8bc3 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683306:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918459.683308:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918459.683309:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918459.683317:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918459.683340:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865621632:0@lo:103: 00000100:00100000:1.0:1788918459.683375:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865621760:0@lo:103: 00000100:00100000:3.0:1788918459.683533:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918459.683577:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865621376 00000100:00100000:0.0:1788918459.683584:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865621376 00010000:00010000:0.0:1788918459.683612:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8c79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c72 expref: 19 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.683645:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865621504 00000100:00100000:0.0:1788918459.683648:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865621504 00010000:00010000:0.0:1788918459.683661:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac8c4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c48 expref: 20 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.683682:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855113728 00000100:00100000:0.0:1788918459.683685:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855113728 00010000:00010000:0.0:1788918459.683697:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8c8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f027a expref: 10 pid: 5916 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.683710:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788918459.683717:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+20:3418:x1875816865621376:12345-0@lo:103: 00010000:00010000:0.0:1788918459.683728:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918459.683739:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8c79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c72 expref: 20 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918459.683750:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788918459.683752:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c72 expref: 20 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.683768:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8c79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c72 expref: 20 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918459.683776:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+20:3418:x1875816865621504:12345-0@lo:103: 00010000:00010000:0.0:1788918459.683786:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788918459.683787:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918459.683794:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac8c4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c48 expref: 19 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683805:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac8c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c48 expref: 19 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.683818:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac8c4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c48 expref: 19 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.683825:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:3418:x1875816865621376:12345-0@lo:103: Request processed in 107us (1389us total) trans 0 rc 0/0 00010000:00010000:1.0:1788918459.683826:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918459.683834:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788918459.683865:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:3418:x1875816865621504:12345-0@lo:103: Request processed in 93us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918459.683868:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:1.0:1788918459.683878:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788918459.683883:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89208175-5136-4226-96dc-dc05cbfafbe9+10:2349:x1875816855113728:12345-192.168.202.49@tcp:103: 00010000:00010000:0.0:1788918459.683894:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918459.683899:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8c8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f027a expref: 10 pid: 5916 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.683909:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f027a expref: 10 pid: 5916 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.683919:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8c8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f027a expref: 10 pid: 5916 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.683926:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918459.683965:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89208175-5136-4226-96dc-dc05cbfafbe9+9:2349:x1875816855113728:12345-192.168.202.49@tcp:103: Request processed in 88us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918459.683971:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:0.0:1788918459.684187:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855113856 00000100:00100000:0.0:1788918459.684200:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855113856 00010000:00010000:0.0:1788918459.684215:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8c87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0273 expref: 9 pid: 5918 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.684238:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:0.0:1788918459.684245:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89208175-5136-4226-96dc-dc05cbfafbe9+9:2349:x1875816855113856:12345-192.168.202.49@tcp:103: 00010000:00010000:0.0:1788918459.684253:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918459.684257:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8c87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0273 expref: 9 pid: 5918 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.684267:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0273 expref: 9 pid: 5918 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.684277:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8c87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0273 expref: 9 pid: 5918 timeout: 261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918459.684299:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918459.684532:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865622016:0@lo:103: 00000100:00100000:1.0:1788918459.684540:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918459.684572:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918459.684610:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865621504:0@lo:103: 00000100:00100000:3.0:1788918459.684620:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865621376:0@lo:103: 00000100:00100000:3.0:1788918459.684652:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918459.684690:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918459.684700:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865622144:0@lo:103: 00000100:00100000:3.0:1788918459.684719:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918459.684734:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865621760 00000100:00100000:3.0:1788918459.684737:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865621760 00010000:00010000:3.0:1788918459.684752:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8c25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c1e expref: 17 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918459.684752:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865622016 00000100:00100000:3.0:1788918459.684766:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865621888 00000100:00100000:3.0:1788918459.684768:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865621888 00010000:00010000:3.0:1788918459.684777:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8c17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c10 expref: 18 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918459.684784:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865621632 00000100:00100000:3.0:1788918459.684786:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865621632 00010000:00010000:3.0:1788918459.684793:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac8c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c2c expref: 19 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918459.684808:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865622144 00000100:00100000:3.0:1788918459.684810:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865622144 00000100:00100000:1.0:1788918459.684818:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865622016 00010000:00010000:3.0:1788918459.684819:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc0030000/0x2811b8b2b0ac8bc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8bbc expref: 20 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918459.684832:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788918459.684836:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8bed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8be6 expref: 21 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918459.684842:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+21:3420:x1875816865621760:12345-0@lo:103: 00010000:00010000:3.0:1788918459.684861:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918459.684866:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8c25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c1e expref: 21 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918459.684866:0:5910:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788918459.684877:0:5910:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:3.0:1788918459.684880:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c1e expref: 21 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918459.684893:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8c25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c1e expref: 21 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918459.684902:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918459.684935:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+20:3420:x1875816865621760:12345-0@lo:103: Request processed in 97us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918459.684942:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788918459.684957:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788918459.684964:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865621888:12345-0@lo:103: 00010000:00010000:3.0:1788918459.684971:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918459.684975:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8c17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c10 expref: 19 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918459.684985:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c10 expref: 19 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918459.684993:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788918459.685004:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5094450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865621632:12345-0@lo:103: 00010000:00010000:3.0:1788918459.685008:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1529a00/0x2811b8b2b0ac8c17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c10 expref: 19 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.685013:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918459.685035:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac8c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c2c expref: 18 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.685043:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac8c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c2c expref: 18 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918459.685052:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918459.685080:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+18:3417:x1875816865621888:12345-0@lo:103: Request processed in 117us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918459.685087:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788918459.685097:0:7989:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788918459.685104:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788918459.685110:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+17:3419:x1875816865622144:12345-0@lo:103: 00010000:00010000:3.0:1788918459.685117:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918459.685121:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc0030000/0x2811b8b2b0ac8bc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8bbc expref: 17 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918459.685130:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc0030000/0x2811b8b2b0ac8bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8bbc expref: 17 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918459.685140:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc0030000/0x2811b8b2b0ac8bc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8bbc expref: 17 pid: 5916 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918459.685148:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918459.685170:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3419:x1875816865622144:12345-0@lo:103: Request processed in 60us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918459.685175:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788918459.685185:0:7989:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1788918459.685272:0:5909:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788918459.685359:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788918459.685366:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+15:3418:x1875816865622016:12345-0@lo:103: 00010000:00010000:3.0:1788918459.685373:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918459.685381:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8bed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8be6 expref: 15 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918459.685390:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8be6 expref: 15 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918459.685400:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1529800/0x2811b8b2b0ac8bed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8be6 expref: 15 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918459.685408:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918459.685432:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+14:3418:x1875816865622016:12345-0@lo:103: Request processed in 67us (862us total) trans 0 rc 0/0 00010000:00010000:1.0:1788918459.685519:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1528e00/0x2811b8b2b0ac8c33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8c2c expref: 14 pid: 5917 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.685534:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.685543:0:5910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.685551:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89208175-5136-4226-96dc-dc05cbfafbe9+8:2349:x1875816855113856:12345-192.168.202.49@tcp:103: Request processed in 1306us (2017us total) trans 0 rc 0/0 00010000:00010000:1.0:1788918459.685555:0:5910:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.685561:0:5910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.685566:0:5910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.685576:0:5910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.685581:0:5910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691e600 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918459.685584:0:5910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918459.685592:0:5910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918459.685602:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1788918459.685617:0:5910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918459.685630:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865622016:0@lo:103: 00010000:00010000:1.0:1788918459.685631:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918459.685667:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5094450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:3419:x1875816865621632:12345-0@lo:103: Request processed in 657us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918459.685678:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788918459.685767:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865621888:0@lo:103: 00000100:00100000:3.0:1788918459.685784:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865621632:0@lo:103: 00000100:00100000:3.0:1788918459.685790:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865622144:0@lo:103: 00000100:00100000:3.0:1788918459.685805:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865621760:0@lo:103: 00010000:00010000:2.0:1788918459.685922:0:8791:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918459.685931:0:8791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918459.685937:0:8791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff691e600/0x2811b8b2b0ac8cc6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918459.688949:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00010000:00010000:1.0:1788918459.926509:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918460.716503:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918460.719433:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855113984 00000100:00100000:3.0:1788918460.719452:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855113984 00000100:00100000:3.0:1788918460.719542:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 128 00000100:00100000:3.0:1788918460.719555:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+8:5435:x1875816855113984:12345-192.168.202.49@tcp:101: 00010000:00010000:3.0:1788918460.719576:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918460.719602:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8ccd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f02dc expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918460.719649:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02dc expref: 9 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918460.719690:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02dc expref: 9 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918460.719702:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4e00, rc 0) 00000100:00100000:3.0:1788918460.719783:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+9:5435:x1875816855113984:12345-192.168.202.49@tcp:101: Request processed in 231us (3295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918460.719790:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 128 00000100:00100000:3.0:1788918460.728692:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918460.728891:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855114112 00000100:00100000:1.0:1788918460.728905:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855114112 00000100:00100000:1.0:1788918460.729058:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 129 00000100:00100000:1.0:1788918460.729072:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+9:5435:x1875816855114112:12345-192.168.202.49@tcp:501: 00000100:00100000:1.0:1788918460.729291:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+9:5435:x1875816855114112:12345-192.168.202.49@tcp:501: Request processed in 221us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918460.729299:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 129 00000100:00100000:0.0:1788918460.730872:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918460.731065:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855114240 00000100:00100000:3.0:1788918460.731072:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855114240 00000100:00100000:3.0:1788918460.731159:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 130 00000100:00100000:3.0:1788918460.731170:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+9:5435:x1875816855114240:12345-192.168.202.49@tcp:503: 00000100:00100000:3.0:1788918460.731315:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+9:5435:x1875816855114240:12345-192.168.202.49@tcp:503: Request processed in 146us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918460.731323:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 130 00000100:00100000:0.0:1788918460.741661:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918460.742055:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855114368 00000100:00100000:1.0:1788918460.742068:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855114368 00000100:00100000:1.0:1788918460.742156:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 131 00000100:00100000:1.0:1788918460.742168:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+9:5902:x1875816855114368:12345-192.168.202.49@tcp:502: 00000100:00100000:1.0:1788918460.742512:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+9:5902:x1875816855114368:12345-192.168.202.49@tcp:502: Request processed in 344us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918460.742522:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 131 00000100:00100000:0.0:1788918460.752680:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918460.752933:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855114496 00000100:00100000:3.0:1788918460.752950:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855114496 00000100:00100000:3.0:1788918460.753065:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 132 00000100:00100000:3.0:1788918460.753079:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+9:5902:x1875816855114496:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788918460.753500:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+9:5902:x1875816855114496:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 423us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918460.753510:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 132 00000100:00100000:0.0:1788918460.756748:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918460.758067:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855114624 00000100:00100000:2.0:1788918460.758079:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855114624 00000100:00100000:2.0:1788918460.758186:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 133 00000100:00100000:2.0:1788918460.758197:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+9:5435:x1875816855114624:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918460.758214:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918460.758232:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff48dd200/0x2811b8b2b0ac8cd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f02e3 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918460.758261:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dd200/0x2811b8b2b0ac8cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02e3 expref: 10 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918460.758271:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff48dd200/0x2811b8b2b0ac8cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02e3 expref: 10 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918460.758280:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd200, rc 0) 00000100:00100000:2.0:1788918460.758340:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+10:5435:x1875816855114624:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 144us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918460.758349:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 133 00000100:00100000:0.0:1788918460.763138:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918460.763255:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855114752 00000100:00100000:3.0:1788918460.763308:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855114752 00000100:00100000:3.0:1788918460.763424:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 134 00000100:00100000:3.0:1788918460.763453:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+10:5435:x1875816855114752:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918460.763615:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+10:5435:x1875816855114752:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 164us (490us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788918460.763624:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 134 00010000:00010000:1.0:1788918460.950445:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788918461.344382:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788918461.344392:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94ffef803800 from 39 10000000:01000000:3.0:1788918461.344401:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788918461.344464:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.344478:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.344492:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918461.344523:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865622272:0@lo:101: 00000100:00100000:3.0:1788918461.344619:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918461.344941:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865622272 00000100:00100000:0.0:1788918461.344951:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865622272 00000100:00100000:0.0:1788918461.345017:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788918461.345070:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+12:5921:x1875816865622272:12345-0@lo:101: 00010000:00010000:0.0:1788918461.345087:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918461.345103:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff691e400/0x2811b8b2b0ac8ce2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8cdb expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.345132:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691e400/0x2811b8b2b0ac8ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8cdb expref: 13 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.345143:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff691e400/0x2811b8b2b0ac8ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8cdb expref: 13 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.345154:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691e400, rc 0) 00000100:00100000:0.0:1788918461.345195:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:5921:x1875816865622272:12345-0@lo:101: Request processed in 128us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918461.345202:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788918461.346795:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788918461.346854:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865622272:0@lo:101: 00010000:00010000:3.0:1788918461.346885:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.346899:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918461.346994:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865622400:0@lo:501: 00000100:00100000:3.0:1788918461.347077:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.347132:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788918461.347268:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865622400 00000100:00100000:0.0:1788918461.347276:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865622400 00000100:00100000:0.0:1788918461.347328:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788918461.347339:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:5921:x1875816865622400:12345-0@lo:501: 00000100:00100000:0.0:1788918461.347508:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:5921:x1875816865622400:12345-0@lo:501: Request processed in 171us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918461.347517:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788918461.351271:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865622400:0@lo:501: 00000100:00100000:3.0:1788918461.351351:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865622528:0@lo:503: 00000100:00100000:3.0:1788918461.351438:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.351489:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.351553:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865622528 00000100:00100000:1.0:1788918461.351561:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865622528 00000100:00100000:1.0:1788918461.351619:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788918461.351629:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+13:5921:x1875816865622528:12345-0@lo:503: 00000100:00100000:1.0:1788918461.351767:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+13:5921:x1875816865622528:12345-0@lo:503: Request processed in 138us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.351774:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788918461.351892:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865622528:0@lo:503: 00000100:00100000:0.0:1788918461.355056:0:8826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8826:1875816865622656:0@lo:502: 00000100:00100000:0.0:1788918461.355166:0:8826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918461.355212:0:8826:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe813c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.355304:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865622656 00000100:00100000:1.0:1788918461.355313:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865622656 00000100:00100000:1.0:1788918461.355372:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788918461.355383:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:8826:x1875816865622656:12345-0@lo:502: 00000100:00100000:1.0:1788918461.355529:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+13:8826:x1875816865622656:12345-0@lo:502: Request processed in 148us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.355536:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788918461.355625:0:8826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8826:1875816865622656:0@lo:502: 00000100:00100000:0.0:1788918461.355674:0:8826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8826:1875816865622784:0@lo:502: 00000100:00100000:0.0:1788918461.355725:0:8826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918461.355746:0:8826:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b35000 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.355865:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865622784 00000100:00100000:1.0:1788918461.355870:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865622784 00000100:00100000:1.0:1788918461.355899:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788918461.355906:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:8826:x1875816865622784:12345-0@lo:502: 00000100:00100000:1.0:1788918461.355973:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:8826:x1875816865622784:12345-0@lo:502: Request processed in 66us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.355980:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788918461.356135:0:8826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8826:1875816865622784:0@lo:502: 00000040:00080000:0.0:1788918461.356154:0:8826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788918461.356320:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788918461.356345:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788918461.356356:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.356368:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918461.356380:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788918461.356384:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788918461.356386:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788918461.356413:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.356421:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.356431:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918461.356444:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865622912:0@lo:101: 00000100:00100000:1.0:1788918461.356473:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918461.356501:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd054bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788918461.356551:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865622912 00000100:00100000:0.0:1788918461.356555:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865622912 00000100:00100000:0.0:1788918461.356583:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788918461.356589:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+13:5921:x1875816865622912:12345-0@lo:101: 00010000:00010000:0.0:1788918461.356599:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918461.356614:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff691ee00/0x2811b8b2b0ac8cf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8ce9 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.356636:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691ee00/0x2811b8b2b0ac8cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8ce9 expref: 14 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.356647:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff691ee00/0x2811b8b2b0ac8cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8ce9 expref: 14 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.356656:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691ee00, rc 0) 00000100:00100000:1.0:1788918461.356800:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865622912:0@lo:101: 00010000:00010000:1.0:1788918461.356812:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.356821:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918461.356912:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865623040:0@lo:501: 00000100:00100000:0.0:1788918461.356947:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865622912:12345-0@lo:101: Request processed in 357us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918461.356953:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788918461.363822:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918461.363904:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd054bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.363983:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865623040 00000100:00100000:1.0:1788918461.363995:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865623040 00000100:00100000:1.0:1788918461.364084:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788918461.364095:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865623040:12345-0@lo:501: 00000100:00100000:1.0:1788918461.364277:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865623040:12345-0@lo:501: Request processed in 184us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.364285:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788918461.364423:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865623040:0@lo:501: 00000100:00100000:0.0:1788918461.364484:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865623168:0@lo:503: 00000100:00100000:0.0:1788918461.364544:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918461.364581:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd054bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.364626:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865623168 00000100:00100000:1.0:1788918461.364631:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865623168 00000100:00100000:1.0:1788918461.364663:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788918461.364670:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865623168:12345-0@lo:503: 00000100:00100000:1.0:1788918461.364902:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865623168:12345-0@lo:503: Request processed in 231us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.364909:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788918461.364986:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865623168:0@lo:503: 00000100:00100000:0.0:1788918461.370412:0:8827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8827:1875816865623296:0@lo:502: 00000100:00100000:0.0:1788918461.370524:0:8827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918461.370583:0:8827:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68a73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918461.370642:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865623296 00000100:00100000:3.0:1788918461.370651:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865623296 00000100:00100000:3.0:1788918461.370718:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788918461.370730:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+14:8827:x1875816865623296:12345-0@lo:502: 00000100:00100000:3.0:1788918461.370893:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+14:8827:x1875816865623296:12345-0@lo:502: Request processed in 165us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918461.370902:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788918461.371059:0:8827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8827:1875816865623296:0@lo:502: 00000020:01000000:0.0:1788918461.371089:0:8827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788918461.371100:0:8827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918461.371102:0:8827:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788918461.371108:0:8827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788918461.371133:0:8827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8827:1875816865623424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918461.371166:0:8827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918461.371190:0:8827:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68a73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918461.371255:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865623424 00000100:00100000:3.0:1788918461.371259:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865623424 00000100:00100000:3.0:1788918461.371285:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788918461.371292:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:8827:x1875816865623424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918461.371353:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:8827:x1875816865623424:12345-0@lo:502:llog_process_th.0 Request processed in 61us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918461.371360:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788918461.371440:0:8827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8827:1875816865623424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788918461.371458:0:8827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788918461.371462:0:8827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918461.371464:0:8827:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788918461.371468:0:8827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788918461.371623:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788918461.371664:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788918461.371677:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.371689:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918461.371708:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788918461.371711:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94fffcaac000 from 39 10000000:01000000:3.0:1788918461.371714:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788918461.371743:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.371752:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.371762:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918461.371777:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865623552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.371808:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.371831:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788918461.372193:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865623552 00000100:00100000:0.0:1788918461.372199:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865623552 00000100:00100000:0.0:1788918461.372228:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788918461.372235:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+14:5921:x1875816865623552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788918461.372245:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918461.372259:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8cfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8cf7 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.372286:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8cf7 expref: 15 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.372299:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8cf7 expref: 15 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.372317:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691e200, rc 0) 00000100:00100000:0.0:1788918461.372351:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865623552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918461.372357:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788918461.372465:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865623552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918461.372480:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.372492:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918461.372547:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865623680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.372575:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.372607:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788918461.372651:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865623680 00000100:00100000:0.0:1788918461.372656:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865623680 00000100:00100000:0.0:1788918461.372696:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788918461.372704:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865623680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918461.372820:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865623680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918461.372828:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788918461.372975:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865623680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.373002:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865623808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.373074:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.373093:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.376953:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865623808 00000100:00100000:1.0:1788918461.376970:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865623808 00000100:00100000:1.0:1788918461.377054:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788918461.377067:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865623808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788918461.377251:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865623808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (4175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.377260:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788918461.379067:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865623808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.383345:0:8829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8829:1875816865623936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918461.383454:0:8829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.383512:0:8829:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.383667:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865623936 00000100:00100000:1.0:1788918461.383677:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865623936 00000100:00100000:1.0:1788918461.383741:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788918461.383759:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+15:8829:x1875816865623936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918461.383929:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+15:8829:x1875816865623936:12345-0@lo:502:llog_process_th.0 Request processed in 172us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.383938:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788918461.383977:0:8829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8829:1875816865623936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918461.384047:0:8829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8829:1875816865624064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918461.384083:0:8829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.384102:0:8829:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.384164:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865624064 00000100:00100000:1.0:1788918461.384169:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865624064 00000100:00100000:1.0:1788918461.384199:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788918461.384206:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+15:8829:x1875816865624064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918461.384267:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+15:8829:x1875816865624064:12345-0@lo:502:llog_process_th.0 Request processed in 60us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.384273:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788918461.384826:0:8829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8829:1875816865624064:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788918461.384863:0:8829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788918461.385169:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788918461.385194:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788918461.385206:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.385219:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918461.385230:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788918461.385234:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788918461.385237:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788918461.385271:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.385279:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.385289:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918461.385313:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865624192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788918461.385351:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918461.385384:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6874e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788918461.386820:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865624192 00000100:00100000:0.0:1788918461.386831:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865624192 00000100:00100000:0.0:1788918461.386893:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788918461.386904:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+15:5921:x1875816865624192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788918461.386921:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918461.386938:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8d0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8d05 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.386968:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d05 expref: 16 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.386981:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d05 expref: 16 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.386991:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691f200, rc 0) 00000100:00100000:0.0:1788918461.387079:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865624192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918461.387086:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788918461.387141:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865624192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788918461.387159:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.387171:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918461.387247:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865624320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918461.387282:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918461.387307:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865624320 00000100:00100000:0.0:1788918461.387311:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865624320 00000100:00100000:0.0:1788918461.387334:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788918461.387341:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865624320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918461.387466:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865624320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918461.387474:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788918461.387506:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68a7180 going to sleep for 11 seconds 00000100:00100000:0.0:1788918461.387516:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865624320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918461.387542:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865624448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788918461.387579:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918461.387594:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865624448 00000100:00100000:0.0:1788918461.387597:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865624448 00000100:00100000:0.0:1788918461.387616:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788918461.387628:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865624448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788918461.388806:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865624448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1176us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918461.388815:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788918461.388865:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68a7180 going to sleep for 11 seconds 00000100:00100000:0.0:1788918461.388878:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865624448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788918461.389322:0:8830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8830:1875816865624576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918461.389359:0:8830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918461.389411:0:8830:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68a7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788918461.392608:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865624576 00000100:00100000:2.0:1788918461.392623:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865624576 00000100:00100000:2.0:1788918461.392699:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788918461.392711:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+16:8830:x1875816865624576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788918461.392921:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+16:8830:x1875816865624576:12345-0@lo:502:llog_process_th.0 Request processed in 211us (3560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918461.392930:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788918461.395801:0:8830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8830:1875816865624576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788918461.395883:0:8830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788918461.395897:0:8830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918461.395900:0:8830:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788918461.395908:0:8830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788918461.395959:0:8830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8830:1875816865624704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918461.396615:0:8830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918461.396662:0:8830:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6874e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788918461.396663:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865624704 00000100:00100000:0.0:1788918461.396671:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865624704 00000100:00100000:0.0:1788918461.396882:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788918461.396895:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:8830:x1875816865624704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918461.397072:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:8830:x1875816865624704:12345-0@lo:502:llog_process_th.0 Request processed in 179us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918461.397080:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788918461.397141:0:8830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8830:1875816865624704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788918461.397166:0:8830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788918461.397172:0:8830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918461.397174:0:8830:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788918461.397179:0:8830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788918461.397317:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788918461.397346:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788918461.397359:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.397372:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918461.397384:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788918461.397387:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94fffbe70000 from 39 10000000:01000000:3.0:1788918461.397391:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788918461.397426:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.397447:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.397458:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918461.397477:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865624832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.397512:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.397549:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.397615:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865624832 00000100:00100000:1.0:1788918461.397621:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865624832 00000100:00100000:1.0:1788918461.397657:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788918461.397665:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865624832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788918461.397675:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918461.397706:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1493e00/0x2811b8b2b0ac8d1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8d13 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.397736:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1493e00/0x2811b8b2b0ac8d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d13 expref: 17 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.397762:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1493e00/0x2811b8b2b0ac8d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d13 expref: 17 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.397772:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1493e00, rc 0) 00000100:00100000:1.0:1788918461.397812:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865624832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.397819:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788918461.397893:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865624832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918461.397908:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.397920:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918461.397980:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865624960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.398005:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.398070:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.398125:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865624960 00000100:00100000:1.0:1788918461.398130:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865624960 00000100:00100000:1.0:1788918461.398148:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788918461.398154:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865624960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788918461.398274:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865624960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.398282:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788918461.398341:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865624960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.398370:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865625088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.398402:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.398424:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.398512:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865625088 00000100:00100000:1.0:1788918461.398516:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865625088 00000100:00100000:1.0:1788918461.398533:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788918461.398539:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865625088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788918461.398623:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865625088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.398629:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788918461.398700:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865625088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.399238:0:8831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8831:1875816865625216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918461.399282:0:8831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.399303:0:8831:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.399340:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865625216 00000100:00100000:1.0:1788918461.399344:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865625216 00000100:00100000:1.0:1788918461.399361:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788918461.399366:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:8831:x1875816865625216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918461.399445:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:8831:x1875816865625216:12345-0@lo:502:llog_process_th.0 Request processed in 78us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.399460:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788918461.399526:0:8831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8831:1875816865625216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918461.399562:0:8831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8831:1875816865625344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918461.399594:0:8831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.399617:0:8831:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.399655:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865625344 00000100:00100000:1.0:1788918461.399659:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865625344 00000100:00100000:1.0:1788918461.399677:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788918461.399684:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:8831:x1875816865625344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918461.399796:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:8831:x1875816865625344:12345-0@lo:502:llog_process_th.0 Request processed in 112us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.399803:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788918461.399991:0:8831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8831:1875816865625344:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788918461.400009:0:8831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788918461.400394:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788918461.400414:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788918461.400423:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.400434:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918461.400445:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788918461.400447:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788918461.400450:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788918461.400473:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.400482:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.400492:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918461.400507:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865625472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788918461.400543:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918461.400603:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffc8a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918461.400646:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865625472 00000100:00100000:0.0:1788918461.400651:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865625472 00000100:00100000:0.0:1788918461.400721:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788918461.400729:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865625472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788918461.400738:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918461.400752:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff691ec00/0x2811b8b2b0ac8d28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8d21 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.400772:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691ec00/0x2811b8b2b0ac8d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d21 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.400794:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff691ec00/0x2811b8b2b0ac8d28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d21 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.400803:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691ec00, rc 0) 00000100:00100000:0.0:1788918461.400887:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865625472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918461.400894:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788918461.400971:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865625472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788918461.400984:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.400994:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918461.401066:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865625600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788918461.401096:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918461.401161:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffc8a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918461.401273:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865625600 00000100:00100000:0.0:1788918461.401277:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865625600 00000100:00100000:0.0:1788918461.401337:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788918461.401344:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865625600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918461.401454:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865625600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918461.401461:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788918461.401511:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865625600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.401534:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865625728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.401569:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.401638:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.401665:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865625728 00000100:00100000:1.0:1788918461.401669:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865625728 00000100:00100000:1.0:1788918461.401688:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788918461.401694:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865625728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788918461.401816:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865625728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.401823:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788918461.401891:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865625728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.402320:0:8832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8832:1875816865625856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918461.402357:0:8832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.402416:0:8832:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788918461.402452:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865625856 00000100:00100000:1.0:1788918461.402456:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865625856 00000100:00100000:1.0:1788918461.402518:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788918461.402525:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:8832:x1875816865625856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918461.402609:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:8832:x1875816865625856:12345-0@lo:502:llog_process_th.0 Request processed in 84us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.402616:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788918461.402680:0:8832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8832:1875816865625856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788918461.402702:0:8832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788918461.402711:0:8832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918461.402714:0:8832:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788918461.402721:0:8832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788918461.402742:0:8832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8832:1875816865625984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918461.402777:0:8832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918461.402880:0:8832:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788918461.402941:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865625984 00000100:00100000:0.0:1788918461.402946:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865625984 00000100:00100000:0.0:1788918461.402966:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788918461.402972:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:8832:x1875816865625984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918461.403076:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:8832:x1875816865625984:12345-0@lo:502:llog_process_th.0 Request processed in 103us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918461.403083:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788918461.403168:0:8832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8832:1875816865625984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788918461.403186:0:8832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918461.403190:0:8832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918461.403192:0:8832:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788918461.403195:0:8832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788918461.403324:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788918461.403345:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788918461.403354:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.403376:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918461.403387:0:5921:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788918461.403389:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94fffbddcd40 from 1 10000000:01000000:0.0:1788918461.403392:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788918461.403413:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0ac8d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.403421:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0ac8d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.403430:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0ac8d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918461.403443:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865626112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788918461.403473:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918461.403498:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68a7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788918461.403539:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865626112 00000100:00100000:3.0:1788918461.403543:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865626112 00000100:00100000:3.0:1788918461.403561:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788918461.403567:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865626112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918461.403574:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918461.403586:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffefbf5400/0x2811b8b2b0ac8d36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8d2f expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.403603:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffefbf5400/0x2811b8b2b0ac8d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d2f expref: 19 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.403612:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffefbf5400/0x2811b8b2b0ac8d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d2f expref: 19 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.403620:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5400, rc 0) 00000100:00100000:3.0:1788918461.403652:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865626112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918461.403658:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788918461.404146:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865626112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788918461.404159:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0ac8d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d36 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.404168:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0ac8d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8d36 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918461.404212:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865626240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918461.404236:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918461.404267:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68a7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788918461.404304:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865626240 00000100:00100000:3.0:1788918461.404308:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865626240 00000100:00100000:3.0:1788918461.404325:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788918461.404330:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865626240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918461.404399:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865626240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (155us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788918461.404413:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788918461.404681:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865626240:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788918461.404706:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788918461.404710:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0ac8d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d36 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.404718:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0ac8d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d36 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788918461.603284:0:8851:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee6301610 20000000:00000080:1.0:1788918461.603306:0:8851:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94ffff7b8800 uarg=0000000000000000 20000000:01000000:1.0:1788918461.603362:0:8851:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788918461.603370:0:8851:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788918461.603376:0:8851:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788918461.603874:0:8852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788918461.604124:0:8851:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788918461.607612:0:8851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788918461.607668:0:8851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788918461.607686:0:8851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788918461.607706:0:8851:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788918461.607732:0:8851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918461.607756:0:8851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1480200/0x2811b8b2b0ac8ab2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8aab expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918461.607765:0:8851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1480a00/0x2811b8b2b0ac8b14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8b0d expref: 18 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918461.607772:0:8851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8bdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8bd8 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918461.607784:0:8851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8c9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ab expref: 9 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918461.607794:0:8851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918461.607924:0:8851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ab expref: 9 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918461.608015:0:8851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8c9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ab expref: 9 pid: 5916 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918461.610777:0:8851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8851:1875816865626368:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918461.611463:0:8851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8bdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8bd8 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918461.611497:0:8851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8bdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8bd8 expref: 18 pid: 5917 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918461.611511:0:8851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8851:1875816865626496:0@lo:104: 00000100:00100000:2.0:1788918461.611577:0:8851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788918461.611640:0:8851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1480a00/0x2811b8b2b0ac8b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8b0d expref: 18 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918461.611649:0:8851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1480a00/0x2811b8b2b0ac8b14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b0d expref: 18 pid: 5916 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918461.611658:0:8851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8851:1875816865626624:0@lo:104: 00000100:00100000:2.0:1788918461.611687:0:8851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788918461.611715:0:8851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1480200/0x2811b8b2b0ac8ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8aab expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918461.611724:0:8851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1480200/0x2811b8b2b0ac8ab2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8aab expref: 18 pid: 5917 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918461.611734:0:8851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8851:1875816865626752:0@lo:104: 00000100:00100000:2.0:1788918461.611754:0:8851:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788918461.612200:0:5907:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788918461.612228:0:5907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918461.612258:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865626496 00000100:00100000:0.0:1788918461.612267:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865626496 00000100:00100000:0.0:1788918461.612319:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865626624 00000100:00100000:0.0:1788918461.612323:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865626624 00000100:00100000:0.0:1788918461.612334:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865626752 00000100:00100000:0.0:1788918461.612337:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865626752 00000100:00100000:0.0:1788918461.612352:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788918461.612362:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+5:8851:x1875816865626496:12345-0@lo:104: 00010000:00010000:0.0:1788918461.612380:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8bdf expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918461.612476:0:8851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8851:1875816865626496:0@lo:104: 00010000:00010000:1.0:1788918461.612505:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788918461.612512:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+5:8851:x1875816865626496:12345-0@lo:104: Request processed in 152us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.612520:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788918461.612679:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918461.612687:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8bdf expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.612696:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1529c00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:0.0:1788918461.612700:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8bdf expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.612724:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8bdf expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788918461.612732:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8bdf expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918461.612738:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788918461.612786:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8bdf expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.612794:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788918461.612821:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8bdf expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.612829:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1529c00/0x2811b8b2b0ac8bd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8bdf expref: -99 pid: 7979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.612853:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918461.612855:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918461.612856:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918461.612870:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865626880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788918461.612908:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918461.612920:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788918461.612929:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff5ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+4:8851:x1875816865626624:12345-0@lo:104: 00010000:00010000:1.0:1788918461.612938:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8b14 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.612985:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788918461.612990:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff5ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+4:8851:x1875816865626624:12345-0@lo:104: Request processed in 65us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.612996:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788918461.613055:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788918461.613063:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:8851:x1875816865626752:12345-0@lo:104: 00010000:00010000:1.0:1788918461.613072:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc0030a00/0x2811b8b2b0ac8aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8ab2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.613104:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788918461.613109:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:8851:x1875816865626752:12345-0@lo:104: Request processed in 48us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.613125:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788918461.613154:0:8851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d99c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8851:1875816865626624:0@lo:104: 00000100:00100000:1.0:1788918461.613162:0:8851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8851:1875816865626752:0@lo:104: 00000100:00100000:2.0:1788918461.613180:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865626880 00000100:00100000:2.0:1788918461.613184:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865626880 00010000:00010000:2.0:1788918461.613227:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8bdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8bd8 expref: 19 pid: 5917 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918461.613271:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788918461.613279:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865626880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788918461.613300:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918461.613307:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8bdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8bd8 expref: 19 pid: 5917 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918461.613317:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8bdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8bd8 expref: 19 pid: 5917 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918461.613334:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1492200/0x2811b8b2b0ac8bdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8bd8 expref: 19 pid: 5917 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918461.613350:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918461.613383:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:3420:x1875816865626880:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918461.613390:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788918461.613417:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865626880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788918461.613587:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788918461.613593:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8b14 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.613600:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031c00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:0.0:1788918461.613604:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8b14 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.613623:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8b14 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788918461.613630:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8b14 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918461.613636:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788918461.613663:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b14 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.613670:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788918461.613690:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b14 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.613697:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac8b0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8b14 expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.613709:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918461.613712:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc0030a00/0x2811b8b2b0ac8aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8ab2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.613718:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030a00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:0.0:1788918461.613721:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030a00/0x2811b8b2b0ac8aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8ab2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.613728:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc0030a00/0x2811b8b2b0ac8aab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8ab2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788918461.613734:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030a00/0x2811b8b2b0ac8aab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8ab2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918461.613746:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788918461.613761:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc0030a00/0x2811b8b2b0ac8aab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8ab2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.613767:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788918461.613773:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc0030a00/0x2811b8b2b0ac8aab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8ab2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.613780:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc0030a00/0x2811b8b2b0ac8aab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8ab2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918461.613794:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918461.613796:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918461.613797:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918461.613810:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865627008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788918461.613855:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918461.613885:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865627008 00000100:00100000:1.0:1788918461.613889:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865627008 00000100:00100000:0.0:1788918461.613890:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788918461.613896:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865627136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788918461.613908:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1480a00/0x2811b8b2b0ac8b14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b0d expref: 18 pid: 5916 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918461.613917:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788918461.614094:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918461.614864:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865627136 00000100:00100000:1.0:1788918461.614871:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865627136 00010000:00010000:1.0:1788918461.614891:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1480200/0x2811b8b2b0ac8ab2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8aab expref: 19 pid: 5917 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918461.614921:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788918461.614930:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865627008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788918461.614940:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918461.614945:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1480a00/0x2811b8b2b0ac8b14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b0d expref: 19 pid: 5916 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.614955:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1480a00/0x2811b8b2b0ac8b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b0d expref: 19 pid: 5916 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.614969:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1480a00/0x2811b8b2b0ac8b14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8b0d expref: 19 pid: 5916 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.614983:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918461.615041:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+18:3417:x1875816865627008:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.615049:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788918461.615078:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788918461.615086:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+17:3417:x1875816865627136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788918461.615094:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918461.615099:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1480200/0x2811b8b2b0ac8ab2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8aab expref: 17 pid: 5917 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.615107:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1480200/0x2811b8b2b0ac8ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8aab expref: 17 pid: 5917 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.615117:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1480200/0x2811b8b2b0ac8ab2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8aab expref: 17 pid: 5917 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.615127:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918461.615150:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3417:x1875816865627136:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.615157:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788918461.615818:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918461.615890:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865627136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788918461.615902:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865627008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788918461.615916:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855114880 00000100:00100000:1.0:1788918461.615921:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855114880 00010000:00010000:1.0:1788918461.615942:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8c9c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ab expref: 10 pid: 5916 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918461.615971:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:1.0:1788918461.615979:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89208175-5136-4226-96dc-dc05cbfafbe9+10:2350:x1875816855114880:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918461.615989:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918461.615994:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8c9c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ab expref: 10 pid: 5916 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.616005:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8c9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ab expref: 10 pid: 5916 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.616071:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.616081:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.616100:0:7989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.616109:0:7989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.616116:0:7989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.616124:0:7989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.616131:0:7989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918461.616136:0:7989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.616145:0:7989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.616155:0:7989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.616167:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918461.616225:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89208175-5136-4226-96dc-dc05cbfafbe9+10:2350:x1875816855114880:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 246us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918461.616241:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 24 00010000:00010000:3.0:1788918461.616374:0:8851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8c9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ab expref: 9 pid: 5916 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918461.616388:0:8851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8851:1875816865626368:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918461.616413:0:8851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.616421:0:8851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.616425:0:8851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918461.616428:0:8851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dc400/0x2811b8b2b0ac8d3d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918461.975079:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918462.039557:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788918462.039589:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865627264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918462.039977:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918462.040076:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865627264 00000100:00100000:3.0:1788918462.040086:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865627264 00000100:00100000:3.0:1788918462.040150:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788918462.040160:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865627264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788918462.041395:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918462.041488:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865627264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1327us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918462.041517:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788918462.041585:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94fff48a7480 x1875816865627264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918462.041610:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865627264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918462.041895:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865627520:0@lo:400:kworker.0 00000100:00100000:0.0:1788918462.041937:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918462.041963:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788918462.041968:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865627648:0@lo:400:kworker.0 00000100:00100000:0.0:1788918462.041996:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918462.042058:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865627520 00000100:00100000:0.0:1788918462.042064:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865627520 00000100:00100000:0.0:1788918462.042105:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865627648 00000100:00100000:0.0:1788918462.042107:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865627648 00000100:00100000:0.0:1788918462.042125:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788918462.042133:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865627520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918462.042173:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865627520:12345-0@lo:400:kworker.0 Request processed in 40us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918462.042293:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788918462.042312:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788918462.042319:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865627648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918462.042347:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865627648:12345-0@lo:400:kworker.0 Request processed in 29us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918462.042353:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788918462.042382:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865627648:0@lo:400:kworker.0 00000100:00100000:0.0:1788918462.042392:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865627520:0@lo:400:kworker.0 00000100:00100000:1.0:1788918462.042846:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865627776:0@lo:400:kworker.0 00000100:00100000:1.0:1788918462.042889:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918462.042925:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788918462.042931:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865627392:0@lo:400:kworker.0 00000100:00100000:1.0:1788918462.042957:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918462.042978:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865627904:0@lo:400:kworker.0 00000100:00100000:1.0:1788918462.042998:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788918462.043017:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788918462.043044:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788918462.043055:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865627904 00000100:00100000:1.0:1788918462.043059:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865627904 00000100:00100000:1.0:1788918462.043090:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788918462.043096:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865627904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918462.043130:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865627904:12345-0@lo:400:kworker.0 Request processed in 34us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918462.043136:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788918462.043154:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865627392 00000100:00100000:1.0:1788918462.043157:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865627392 00000100:00100000:0.0:1788918462.043362:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865627776 00000100:00100000:0.0:1788918462.043366:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865627776 00000100:00100000:0.0:1788918462.043403:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788918462.043410:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865627776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918462.043441:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865627776:12345-0@lo:400:kworker.0 Request processed in 32us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918462.043447:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788918462.043476:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788918462.043478:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918462.043521:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865627904:0@lo:400:kworker.0 00010000:00080000:0.0:1788918462.043533:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7c0380 x1875816865627776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918462.043544:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865627776:0@lo:400:kworker.0 00000100:00100000:1.0:1788918462.043583:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788918462.043592:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3419:x1875816865627392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918462.043624:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3419:x1875816865627392:12345-0@lo:400:kworker.0 Request processed in 34us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918462.044862:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865627392:0@lo:400:kworker.0 00000100:00100000:1.0:1788918462.046484:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788918462.550568:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788918462.550606:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865628032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918462.550677:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918462.551850:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865628032 00000100:00100000:3.0:1788918462.551868:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865628032 00000100:00100000:3.0:1788918462.551951:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788918462.551963:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865628032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788918462.552007:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918462.552125:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865628032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918462.552134:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788918462.552679:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff731880 x1875816865628032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918462.552704:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865628032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788918462.580265:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918462.581963:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855115008 00000100:00100000:1.0:1788918462.581978:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855115008 00000100:00100000:1.0:1788918462.582067:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 168 00000100:00100000:1.0:1788918462.582080:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+9:5435:x1875816855115008:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788918462.582102:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918462.582126:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1493c00/0x2811b8b2b0ac8d44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f02ea expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918462.582175:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1493c00/0x2811b8b2b0ac8d44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ea expref: 10 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918462.582191:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1493c00/0x2811b8b2b0ac8d44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ea expref: 10 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918462.582202:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1493c00, rc 0) 00000100:00100000:1.0:1788918462.582286:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+10:5435:x1875816855115008:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 209us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918462.582295:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 168 00000100:00100000:2.0:1788918462.585333:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918462.585414:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855115136 00000100:00100000:3.0:1788918462.585426:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855115136 00000100:00100000:3.0:1788918462.585492:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 169 00000100:00100000:3.0:1788918462.585517:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+10:5435:x1875816855115136:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918462.585701:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+10:5435:x1875816855115136:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 199us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918462.585710:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 169 00000100:00100000:2.0:1788918462.586951:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918462.587008:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855115264 00000100:00100000:3.0:1788918462.587015:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855115264 00000100:00100000:3.0:1788918462.587068:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 170 00000100:00100000:3.0:1788918462.587075:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+10:5435:x1875816855115264:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918462.587186:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+10:5435:x1875816855115264:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 110us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918462.587199:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 170 00000100:00100000:2.0:1788918462.589238:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918462.589311:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855115392 00000100:00100000:3.0:1788918462.589321:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855115392 00000100:00100000:3.0:1788918462.589369:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 171 00000100:00100000:3.0:1788918462.589378:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:5965:x1875816855115392:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788918462.589503:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:5965:x1875816855115392:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 125us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918462.589512:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 171 00000100:00100000:2.0:1788918462.594684:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918462.594819:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855115520 00000100:00100000:1.0:1788918462.594840:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855115520 00000100:00100000:1.0:1788918462.594942:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 172 00000100:00100000:1.0:1788918462.594955:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+10:5965:x1875816855115520:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788918462.595173:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+10:5965:x1875816855115520:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 207us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918462.595182:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 172 10000000:01000000:2.0:1788918462.614093:0:5921:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788918462.614103:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94ffef803800 from 4 10000000:01000000:2.0:1788918462.614109:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788918462.614168:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918462.614182:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918462.614209:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918462.614245:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865628160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788918462.614334:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918462.614394:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788918462.614439:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865628160 00000100:00100000:2.0:1788918462.614447:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865628160 00000100:00100000:2.0:1788918462.614504:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788918462.614515:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865628160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918462.614546:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918462.614563:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff48dd000/0x2811b8b2b0ac8d52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8d4b expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918462.614592:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dd000/0x2811b8b2b0ac8d52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d4b expref: 17 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918462.614605:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff48dd000/0x2811b8b2b0ac8d52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d4b expref: 17 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918462.614616:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd000, rc 0) 00000100:00100000:2.0:1788918462.614659:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865628160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918462.614666:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788918462.614724:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865628160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918462.614741:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d52 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918462.614758:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8d52 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918462.614837:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865628288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788918462.614866:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918462.614890:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788918462.614948:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865628288 00000100:00100000:1.0:1788918462.614954:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865628288 00000100:00100000:1.0:1788918462.614992:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788918462.615000:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865628288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788918462.615152:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865628288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918462.615158:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865628288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788918462.615160:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788918462.615185:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865628416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918462.615229:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918462.615250:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788918462.615265:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865628416 00000100:00100000:2.0:1788918462.615269:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865628416 00000100:00100000:2.0:1788918462.615291:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788918462.615297:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865628416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918462.615378:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865628416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918462.615385:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788918462.615428:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865628416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918462.616774:0:8914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8914:1875816865628544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788918462.616845:0:8914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918462.616876:0:8914:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788918462.620464:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865628544 00000100:00100000:1.0:1788918462.620481:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865628544 00000100:00100000:1.0:1788918462.620580:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788918462.620594:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:8914:x1875816865628544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918462.620813:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:8914:x1875816865628544:12345-0@lo:502:llog_process_th.0 Request processed in 221us (3967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918462.620821:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788918462.621223:0:8914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8914:1875816865628544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788918462.621267:0:8914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788918462.621279:0:8914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918462.621282:0:8914:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788918462.621290:0:8914:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94ffef803800 00000020:00000080:1.0:1788918462.621292:0:8914:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788918462.623106:0:8914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8914:1875816865628672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918462.623180:0:8914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918462.623225:0:8914:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe4b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918462.628296:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865628672 00000100:00100000:2.0:1788918462.628316:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865628672 00000100:00100000:2.0:1788918462.628381:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788918462.628400:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:8914:x1875816865628672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788918462.630217:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:8914:x1875816865628672:12345-0@lo:502:llog_process_th.0 Request processed in 1812us (7027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918462.630231:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788918462.631381:0:8914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8914:1875816865628672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788918462.631429:0:8914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788918462.631439:0:8914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918462.631442:0:8914:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788918462.631448:0:8914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788918462.636635:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788918462.636678:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788918462.636693:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d52 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918462.636708:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d52 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918462.636720:0:5921:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788918462.636724:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94fffcaac000 from 4 10000000:01000000:2.0:1788918462.636728:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788918462.636777:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918462.636786:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918462.636799:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918462.636843:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865628800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788918462.637047:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918462.637109:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918462.638062:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865628800 00000100:00100000:1.0:1788918462.638073:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865628800 00000100:00100000:1.0:1788918462.638130:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788918462.638140:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865628800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788918462.638157:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918462.638173:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8d60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8d59 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918462.638202:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d59 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918462.638215:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d59 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918462.638225:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1493400, rc 0) 00000100:00100000:1.0:1788918462.638277:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865628800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918462.638284:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788918462.638338:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865628800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788918462.638354:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d60 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918462.638364:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8d60 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918462.638438:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865628928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788918462.638468:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918462.638490:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe4bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788918462.643642:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865628928 00000100:00100000:1.0:1788918462.643659:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865628928 00000100:00100000:1.0:1788918462.643743:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788918462.643756:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865628928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788918462.643985:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865628928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (5515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918462.643995:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788918462.644088:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865628928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788918462.644162:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865629056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788918462.644220:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918462.644256:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe4bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788918462.644289:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865629056 00000100:00100000:1.0:1788918462.644293:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865629056 00000100:00100000:1.0:1788918462.644325:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788918462.644332:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865629056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788918462.644419:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865629056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918462.644427:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788918462.644474:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865629056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918462.664834:0:8919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8919:1875816865629184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788918462.664946:0:8919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918462.664996:0:8919:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788918462.666674:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865629184 00000100:00100000:1.0:1788918462.666982:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865629184 00000100:00100000:1.0:1788918462.667074:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788918462.667085:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+18:8919:x1875816865629184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918462.667279:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+18:8919:x1875816865629184:12345-0@lo:502:llog_process_th.0 Request processed in 195us (2332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918462.667288:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788918462.670810:0:8919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8919:1875816865629184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788918462.670878:0:8919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918462.670890:0:8919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918462.670893:0:8919:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788918462.670901:0:8919:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94fffcaac000 00000020:00000080:2.0:1788918462.670904:0:8919:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788918462.671003:0:8919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8919:1875816865629312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788918462.671106:0:8919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918462.671147:0:8919:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788918462.672664:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865629312 00000100:00100000:1.0:1788918462.672676:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865629312 00000100:00100000:1.0:1788918462.672733:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788918462.672744:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:8919:x1875816865629312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918462.676195:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:8919:x1875816865629312:12345-0@lo:502:llog_process_th.0 Request processed in 3443us (5079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918462.676213:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788918462.681313:0:8919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8919:1875816865629312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788918462.682072:0:8919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918462.682084:0:8919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918462.682087:0:8919:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788918462.682092:0:8919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788918462.686613:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788918462.686661:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788918462.686676:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d60 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918462.687521:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d60 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918462.687536:0:5921:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788918462.687540:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94fffbe70000 from 4 10000000:01000000:1.0:1788918462.687544:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788918462.687597:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918462.687606:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918462.687631:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918462.687667:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865629440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788918462.687965:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918462.688013:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe4b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788918462.688833:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865629440 00000100:00100000:2.0:1788918462.688844:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865629440 00000100:00100000:2.0:1788918462.688907:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788918462.688919:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865629440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918462.688937:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918462.688956:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8d6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8d67 expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918462.688989:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d67 expref: 19 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918462.689002:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d67 expref: 19 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918462.689040:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dda00, rc 0) 00000100:00100000:2.0:1788918462.689100:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865629440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918462.689108:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788918462.689170:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865629440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918462.689190:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d6e expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918462.689202:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8d6e expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918462.690393:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865629568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788918462.690448:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918462.690530:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788918462.695386:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865629568 00000100:00100000:0.0:1788918462.695408:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865629568 00000100:00100000:0.0:1788918462.695475:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788918462.695488:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865629568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918462.695908:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865629568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 422us (5458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918462.695917:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788918462.696131:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865629568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788918462.696198:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865629696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918462.696634:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918462.696738:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788918462.697442:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865629696 00000100:00100000:3.0:1788918462.697452:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865629696 00000100:00100000:3.0:1788918462.697495:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788918462.697505:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865629696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918462.697631:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865629696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918462.697639:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788918462.697686:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865629696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918462.697907:0:8924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8924:1875816865629824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918462.697949:0:8924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918462.697971:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865629824 00000100:00100000:3.0:1788918462.697974:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865629824 00000100:00100000:3.0:1788918462.697991:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788918462.697997:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:8924:x1875816865629824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918462.698085:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:8924:x1875816865629824:12345-0@lo:502:llog_process_th.0 Request processed in 88us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918462.698099:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788918462.698122:0:8924:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd05af6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918462.698133:0:8924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8924:1875816865629824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788918462.698152:0:8924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788918462.698164:0:8924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918462.698166:0:8924:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788918462.698173:0:8924:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94fffbe70000 00000020:00000080:3.0:1788918462.698176:0:8924:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788918462.698253:0:8924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8924:1875816865629952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918462.698285:0:8924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918462.698302:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865629952 00000100:00100000:3.0:1788918462.698305:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865629952 00000100:00100000:3.0:1788918462.698320:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788918462.698325:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:8924:x1875816865629952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918462.698377:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:8924:x1875816865629952:12345-0@lo:502:llog_process_th.0 Request processed in 50us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918462.698383:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788918462.698405:0:8924:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd05af6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918462.698415:0:8924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:8924:1875816865629952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788918462.698430:0:8924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918462.698434:0:8924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918462.698435:0:8924:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788918462.698439:0:8924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788918462.698484:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788918462.698505:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788918462.698515:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d6e expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918462.698531:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d6e expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918463.000884:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918463.153406:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918463.153493:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918463.153565:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855115648 00000100:00100000:0.0:1788918463.153576:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855115648 00000100:00100000:0.0:1788918463.153651:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:0.0:1788918463.153662:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855115648:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918463.153743:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855115648:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 83us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918463.153751:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00080000:3.0:1788918463.153816:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918463.154320:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855115776 00000100:00100000:1.0:1788918463.154325:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855115776 00000100:00100000:1.0:1788918463.154373:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788918463.154381:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2351:x1875816855115776:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918463.154417:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2351:x1875816855115776:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 37us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918463.154424:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00080000:3.0:1788918463.154533:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918463.158833:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918463.158953:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855115904 00000100:00100000:1.0:1788918463.158963:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855115904 00000100:00100000:1.0:1788918463.159057:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:1.0:1788918463.159068:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855115904:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918463.159146:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855115904:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 79us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918463.159153:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00080000:3.0:1788918463.159304:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788918464.022262:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918465.050941:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918466.078458:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788918466.312683:0:9149:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788918467.097444:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918467.158273:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865630208:0@lo:400:kworker.0 00000100:00100000:0.0:1788918467.158343:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918467.158427:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865630208 00000100:00100000:0.0:1788918467.158436:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865630208 00000100:00100000:0.0:1788918467.158480:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788918467.158503:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865630208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918467.158554:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865630208:12345-0@lo:400:kworker.0 Request processed in 51us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918467.158562:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788918467.158606:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865630208:0@lo:400:kworker.0 00000100:00100000:0.0:1788918467.158678:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865630720:0@lo:400:kworker.0 00000100:00100000:0.0:1788918467.158699:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918467.158718:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788918467.158721:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865630336:0@lo:400:kworker.0 00000100:00100000:0.0:1788918467.158733:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918467.158748:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865630720 00000100:00100000:0.0:1788918467.158750:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865630720 00000100:00100000:0.0:1788918467.158796:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788918467.158804:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865630720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918467.158841:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865630720:12345-0@lo:400:kworker.0 Request processed in 39us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918467.158848:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788918467.158861:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865630080:0@lo:400:kworker.0 00000100:00100000:0.0:1788918467.158861:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865630336 00000100:00100000:0.0:1788918467.158864:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865630336 00000100:00100000:0.0:1788918467.158885:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788918467.158890:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865630336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918467.158899:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918467.158916:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865630336:12345-0@lo:400:kworker.0 Request processed in 26us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918467.158920:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865630592:0@lo:400:kworker.0 00000100:00100000:0.0:1788918467.158922:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788918467.158940:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918467.158949:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865630336:0@lo:400:kworker.0 00000100:00100000:1.0:1788918467.158958:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788918467.158962:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865630464:0@lo:400:kworker.0 00010000:00080000:0.0:1788918467.158969:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7c0e00 x1875816865630720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918467.158979:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865630720:0@lo:400:kworker.0 00000100:00100000:1.0:1788918467.158981:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918467.159001:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865630464 00000100:00100000:1.0:1788918467.159005:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865630464 00000100:00100000:0.0:1788918467.159010:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865630592 00000100:00100000:0.0:1788918467.159012:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865630592 00000100:00100000:1.0:1788918467.159049:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788918467.159049:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788918467.159055:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865630592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918467.159056:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865630464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918467.159276:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865630592:12345-0@lo:400:kworker.0 Request processed in 220us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918467.159283:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788918467.159758:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788918467.159763:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788918467.159765:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788918467.159775:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865630080 00000100:00100000:3.0:1788918467.159780:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865630080 00000100:00100000:3.0:1788918467.159852:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788918467.159861:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865630080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918467.160538:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865630848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918467.160576:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918467.162143:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865630848 00000100:00100000:2.0:1788918467.162153:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865630848 00000100:00100000:2.0:1788918467.162267:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788918467.162277:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865630848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788918467.162317:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918467.162376:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865630848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918467.162383:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788918467.162424:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94fffc876300 x1875816865630848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918467.162444:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865630848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918467.162909:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865630464:12345-0@lo:400:kworker.0 Request processed in 3852us (3925us total) trans 0 rc 0/0 00010000:00080000:0.0:1788918467.162917:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7c1880 x1875816865630464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918467.162919:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788918467.162928:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865630464:0@lo:400:kworker.0 00000100:00100000:3.0:1788918467.164724:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865630080:12345-0@lo:400:kworker.0 Request processed in 4855us (5814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918467.164736:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788918467.167339:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865630080:0@lo:400:kworker.0 00000100:00100000:0.0:1788918467.167361:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865630592:0@lo:400:kworker.0 00000100:00100000:1.0:1788918467.671103:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788918467.671122:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865630976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918467.671175:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918467.671308:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865630976 00000100:00100000:2.0:1788918467.671314:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865630976 00000100:00100000:2.0:1788918467.671354:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788918467.671363:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865630976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918467.671391:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918467.671618:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865630976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 255us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918467.671623:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788918467.673736:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94fffc876300 x1875816865630976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918467.673761:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865630976:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788918468.118423:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918468.271269:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918468.271305:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918468.271331:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918468.271354:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918468.271385:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855116288 00000100:00100000:1.0:1788918468.271385:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855116032 00000100:00100000:2.0:1788918468.271394:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855116288 00000100:00100000:1.0:1788918468.271394:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855116032 00000100:00100000:2.0:1788918468.271435:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855116416 00000100:00100000:2.0:1788918468.271438:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855116416 00000100:00100000:1.0:1788918468.271439:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 189 00000100:00100000:1.0:1788918468.271448:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+10:2352:x1875816855116032:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918468.271456:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:2.0:1788918468.271461:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855116288:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918468.271506:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855116288:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 43us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918468.271519:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:2.0:1788918468.271534:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:2.0:1788918468.271539:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855116416:12345-192.168.202.49@tcp:400:kworker.0 00000100:00080000:3.0:1788918468.272096:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788918468.272101:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918468.272113:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855116160 00000100:00100000:3.0:1788918468.272117:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855116160 00000100:00100000:3.0:1788918468.272154:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:3.0:1788918468.272161:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855116160:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918468.272252:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855116416:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 710us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918468.272252:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+10:2352:x1875816855116032:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 803us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918468.272260:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:1.0:1788918468.272260:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 189 00000100:00100000:3.0:1788918468.272660:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855116160:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 499us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918468.272678:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00080000:3.0:1788918468.272695:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788918469.142202:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788918470.092122:0:9393:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing yml_node 00010000:00010000:1.0:1788918470.169328:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918471.190297:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918472.214845:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918472.278356:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865631232:0@lo:400:kworker.0 00000100:00100000:2.0:1788918472.278373:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865631488:0@lo:400:kworker.0 00000100:00100000:3.0:1788918472.278468:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865631360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918472.278521:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865631104:0@lo:400:kworker.0 00000100:00100000:3.0:1788918472.282278:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918472.282476:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865631360 00000100:00100000:3.0:1788918472.282485:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865631360 00000100:00100000:3.0:1788918472.282555:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788918472.282565:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865631360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788918472.282596:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918472.282646:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865631360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918472.282653:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788918472.282673:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788918472.282701:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7f9180 x1875816865631360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918472.282730:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865631360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918472.284692:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918472.284757:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865631232 00000100:00100000:1.0:1788918472.284761:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865631744:0@lo:400:kworker.0 00000100:00100000:2.0:1788918472.284764:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865631232 00000100:00100000:1.0:1788918472.284797:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918472.284804:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865631744 00000100:00100000:2.0:1788918472.284807:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865631744 00000100:00100000:2.0:1788918472.284830:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788918472.284838:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865631232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918472.284883:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865631232:12345-0@lo:400:kworker.0 Request processed in 45us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918472.284889:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788918472.284906:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788918472.284913:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865631744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918472.284939:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865631744:12345-0@lo:400:kworker.0 Request processed in 27us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918472.284945:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788918472.284964:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918472.285012:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865631232:0@lo:400:kworker.0 00000100:00100000:1.0:1788918472.285052:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865631744:0@lo:400:kworker.0 00000100:00100000:3.0:1788918472.285088:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918472.285115:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865631488 00000100:00100000:3.0:1788918472.285117:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865631872:0@lo:400:kworker.0 00000100:00100000:2.0:1788918472.285118:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865631488 00000100:00100000:3.0:1788918472.285144:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918472.285168:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788918472.285174:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865631488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918472.285218:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865631488:12345-0@lo:400:kworker.0 Request processed in 44us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918472.285224:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788918472.285243:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865631488:0@lo:400:kworker.0 00000100:00100000:3.0:1788918472.285268:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865631872 00000100:00100000:3.0:1788918472.285272:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865631872 00000100:00080000:1.0:1788918472.285277:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918472.285296:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788918472.285303:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865631872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918472.285346:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865631872:12345-0@lo:400:kworker.0 Request processed in 44us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918472.285359:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788918472.285363:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788918472.285427:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff730380 x1875816865631872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918472.285439:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865631872:0@lo:400:kworker.0 00000100:00100000:0.0:1788918472.285547:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865631616:0@lo:400:kworker.0 00000100:00100000:0.0:1788918472.285592:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918472.285800:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865631616 00000100:00100000:2.0:1788918472.285805:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865631616 00000100:00100000:2.0:1788918472.285897:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788918472.285906:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865631616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918472.285943:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865631616:12345-0@lo:400:kworker.0 Request processed in 39us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918472.285948:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788918472.285991:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788918472.286163:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff732300 x1875816865631616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918472.286174:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865631616:0@lo:400:kworker.0 00000100:00100000:1.0:1788918472.291727:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865631104 00000100:00100000:1.0:1788918472.291770:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865631104 00000100:00100000:1.0:1788918472.291850:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788918472.291862:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865631104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918472.292153:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865631104:12345-0@lo:400:kworker.0 Request processed in 292us (6787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918472.292161:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788918472.293626:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865631104:0@lo:400:kworker.0 00000100:00100000:3.0:1788918472.790259:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865632000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918472.790321:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918472.790423:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865632000 00000100:00100000:0.0:1788918472.790430:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865632000 00000100:00100000:0.0:1788918472.790488:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788918472.790498:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865632000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788918472.790524:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918472.795853:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865632000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5346us (5520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918472.795867:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788918472.795869:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7f8700 x1875816865632000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918472.796316:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865632000:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788918473.138457:0:9576:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:0.0:1788918473.238099:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918473.388309:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918473.388368:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918473.388406:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918473.388435:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918473.388468:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855116672 00000100:00100000:3.0:1788918473.388477:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855116672 00000100:00100000:3.0:1788918473.388536:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:3.0:1788918473.388546:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855116672:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918473.388692:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855116672:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 146us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918473.388701:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:3.0:1788918473.388737:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855116800 00000100:00100000:3.0:1788918473.388741:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855116800 00000100:00100000:3.0:1788918473.388765:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855116928 00000100:00100000:3.0:1788918473.388767:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855116928 00000100:00100000:3.0:1788918473.388788:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:3.0:1788918473.388794:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855116800:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918473.388820:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855116800:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 26us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918473.388827:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:3.0:1788918473.388838:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:3.0:1788918473.388844:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855116928:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918473.388873:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855116928:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 30us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918473.388879:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00080000:3.0:1788918473.388895:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788918473.388898:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788918473.388901:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918473.389077:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855116544 00000100:00100000:1.0:1788918473.389081:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855116544 00000100:00100000:1.0:1788918473.389108:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 191 00000100:00100000:1.0:1788918473.389114:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:2352:x1875816855116544:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918473.389145:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:2352:x1875816855116544:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 31us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918473.389151:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 191 00010000:00010000:1.0:1788918474.263163:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788918474.769531:0:9673:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:3.0:1788918475.287678:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918476.310288:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788918476.661173:0:9771:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:3.0:1788918477.334360:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918477.398307:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788918477.398538:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865632256:0@lo:400:kworker.0 00000100:00100000:2.0:1788918477.398636:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918477.398682:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865632256 00000100:00100000:1.0:1788918477.398704:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865632256 00000100:00100000:2.0:1788918477.398710:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788918477.398716:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865632384:0@lo:400:kworker.0 00000100:00100000:2.0:1788918477.398744:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918477.398768:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788918477.398778:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865632256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918477.398848:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865632256:12345-0@lo:400:kworker.0 Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918477.398855:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788918477.399054:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865632384 00000100:00100000:1.0:1788918477.399058:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865632384 00000100:00100000:2.0:1788918477.399065:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865632256:0@lo:400:kworker.0 00000100:00100000:1.0:1788918477.399087:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788918477.399093:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865632384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918477.399153:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865632384:12345-0@lo:400:kworker.0 Request processed in 57us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918477.399160:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788918477.399228:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865632384:0@lo:400:kworker.0 00000100:00100000:3.0:1788918477.399285:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865632512:0@lo:400:kworker.0 00000100:00100000:3.0:1788918477.399321:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918477.399373:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865632128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918477.399396:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918477.399447:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865632128 00000100:00100000:2.0:1788918477.399449:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865632512 00000100:00100000:2.0:1788918477.399452:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865632512 00000100:00100000:1.0:1788918477.399452:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865632128 00000100:00100000:2.0:1788918477.399532:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788918477.399540:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865632512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918477.399575:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865632512:12345-0@lo:400:kworker.0 Request processed in 37us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918477.399575:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788918477.399582:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788918477.399582:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865632128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918477.399611:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918477.399625:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865632512:0@lo:400:kworker.0 00000100:00100000:2.0:1788918477.399635:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788918477.399643:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865632640:0@lo:400:kworker.0 00000100:00100000:1.0:1788918477.399646:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865632128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918477.399653:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788918477.399668:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788918477.399709:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7f8700 x1875816865632128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918477.399724:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865632128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918477.399741:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865632640 00000100:00100000:2.0:1788918477.399744:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865632640 00000100:00100000:2.0:1788918477.399772:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788918477.399776:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865632640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918477.399811:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865632640:12345-0@lo:400:kworker.0 Request processed in 33us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918477.399818:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788918477.399837:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00080000:0.0:1788918477.399839:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7c0380 x1875816865632640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918477.399847:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865632768:0@lo:400:kworker.0 00000100:00100000:0.0:1788918477.399853:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865632640:0@lo:400:kworker.0 00000100:00100000:2.0:1788918477.399889:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918477.399928:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865632768 00000100:00100000:1.0:1788918477.399932:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865632768 00000100:00100000:1.0:1788918477.399965:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788918477.399972:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865632768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918477.400012:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865632768:12345-0@lo:400:kworker.0 Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918477.400038:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788918477.400058:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865632768:0@lo:400:kworker.0 00000100:00080000:3.0:1788918477.400137:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788918477.400142:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788918477.400144:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788918477.803004:0:9819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 21:47:55 EDT 2026 00000100:00100000:2.0:1788918477.910676:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865632896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788918477.910762:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918477.910889:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865632896 00000100:00100000:1.0:1788918477.910897:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865632896 00000100:00100000:1.0:1788918477.910960:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788918477.910971:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865632896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788918477.911002:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918477.911083:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865632896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918477.911091:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788918477.911178:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff730e00 x1875816865632896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918477.911198:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865632896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788918478.359878:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918478.514876:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918478.514935:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918478.514969:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918478.514997:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918478.516867:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855117056 00000100:00100000:3.0:1788918478.516890:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855117056 00000100:00100000:3.0:1788918478.516991:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 193 00000100:00100000:3.0:1788918478.517005:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+10:2352:x1875816855117056:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918478.517125:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855117184 00000100:00100000:2.0:1788918478.517131:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855117184 00000100:00100000:3.0:1788918478.517137:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+10:2352:x1875816855117056:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 135us (2276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918478.517155:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 193 00000100:00100000:2.0:1788918478.517177:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00100000:2.0:1788918478.517184:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855117184:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918478.524385:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855117184:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 7176us (9424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918478.524404:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00080000:2.0:1788918478.524453:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918478.526067:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855117312 00000100:00100000:1.0:1788918478.526475:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855117312 00000100:00100000:1.0:1788918478.526571:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855117440 00000100:00100000:1.0:1788918478.526576:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855117440 00000100:00100000:1.0:1788918478.526614:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788918478.526626:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+5:2348:x1875816855117312:12345-192.168.202.49@tcp:9:kworker.0 00000020:00000080:1.0:1788918478.526673:0:6912:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8caa 00000100:00080000:1.0:1788918478.526698:0:6912:0:(import.c:65:import_set_state_nolock()) ffff94ffd0439000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788918478.526757:0:6912:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788918478.526992:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+2:2348:x1875816855117312:12345-192.168.202.49@tcp:9:kworker.0 Request processed in 368us (12020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918478.527001:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788918478.527043:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:1.0:1788918478.527051:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+5:2348:x1875816855117440:12345-192.168.202.49@tcp:9:kworker.0 00000020:00000080:1.0:1788918478.527066:0:6912:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8cb1 00000100:00080000:1.0:1788918478.527073:0:6912:0:(import.c:65:import_set_state_nolock()) ffff94ffd043b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788918478.527112:0:6912:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788918478.527197:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+2:2348:x1875816855117440:12345-192.168.202.49@tcp:9:kworker.0 Request processed in 146us (12197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918478.528352:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00080000:1.0:1788918478.528395:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788918478.528401:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788918478.529086:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918478.533778:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918479.382181:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918480.408434:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918481.442706:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918482.454206:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918482.518803:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865633024:0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.518874:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918482.518922:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865633536:0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.518948:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918482.518978:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788918482.518985:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865633152:0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519009:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918482.519048:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865633664:0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519077:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918482.519106:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865633280:0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519133:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918482.519148:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788918482.519153:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865633408:0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519170:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918482.519196:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865633024 00000100:00100000:3.0:1788918482.519202:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865633024 00000100:00100000:3.0:1788918482.519242:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788918482.519250:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865633024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519291:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865633024:12345-0@lo:400:kworker.0 Request processed in 42us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918482.519298:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788918482.519326:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865633536 00000100:00100000:3.0:1788918482.519329:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865633536 00000100:00100000:3.0:1788918482.519360:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865633152 00000100:00100000:3.0:1788918482.519363:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865633152 00000100:00100000:3.0:1788918482.519373:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865633280 00000100:00100000:3.0:1788918482.519374:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865633280 00000100:00100000:3.0:1788918482.519386:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788918482.519392:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865633536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519420:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865633536:12345-0@lo:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918482.519426:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788918482.519436:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788918482.519441:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865633152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519461:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865633152:12345-0@lo:400:kworker.0 Request processed in 20us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918482.519466:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788918482.519475:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788918482.519480:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865633280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519503:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865633280:12345-0@lo:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918482.519509:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788918482.519527:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865633664 00000100:00100000:3.0:1788918482.519530:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865633664 00000100:00100000:3.0:1788918482.519552:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865633408 00000100:00100000:3.0:1788918482.519555:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865633408 00000100:00100000:3.0:1788918482.519570:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788918482.519576:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865633664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519600:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865633664:12345-0@lo:400:kworker.0 Request processed in 25us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918482.519615:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788918482.519625:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788918482.519630:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865633408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519671:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865633408:12345-0@lo:400:kworker.0 Request processed in 40us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918482.519678:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788918482.519704:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788918482.519708:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788918482.519711:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788918482.519741:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff730e00 x1875816865633408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918482.519754:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865633408:0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519764:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865633280:0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519796:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865633152:0@lo:400:kworker.0 00010000:00080000:3.0:1788918482.519804:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff732300 x1875816865633664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918482.519812:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865633664:0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519818:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865633024:0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519825:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865633536:0@lo:400:kworker.0 00000100:00100000:3.0:1788918482.519986:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788918482.519996:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865633792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918482.520052:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918482.520094:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865633792 00000100:00100000:3.0:1788918482.520098:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865633792 00000100:00100000:3.0:1788918482.520131:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788918482.520140:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865633792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788918482.520174:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918482.520215:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865633792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918482.520223:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788918482.520232:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefd1b800 x1875816865633792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918482.520248:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865633792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918483.035189:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865633920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788918483.035258:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918483.035400:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865633920 00000100:00100000:3.0:1788918483.035409:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865633920 00000100:00100000:3.0:1788918483.035467:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788918483.035477:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865633920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788918483.035505:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918483.035892:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865633920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 416us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918483.035900:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788918483.035946:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff730380 x1875816865633920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918483.035960:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865633920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788918483.480820:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918483.632643:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918483.632699:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918483.632767:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855117696 00000100:00100000:3.0:1788918483.632777:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855117696 00000100:00100000:3.0:1788918483.632848:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:3.0:1788918483.632860:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855117696:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918483.632935:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855117696:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 76us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918483.632943:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:2.0:1788918483.632947:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855117568 00000100:00100000:2.0:1788918483.632953:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855117568 00000100:00080000:0.0:1788918483.633004:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918483.633005:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 195 00000100:00100000:2.0:1788918483.633015:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+10:2349:x1875816855117568:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918483.633066:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+10:2349:x1875816855117568:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 53us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918483.633073:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 195 00010000:00010000:0.0:1788918484.502157:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788918484.568332:0:7980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00000020:00000080:1.0:1788918484.568341:0:7980:0:(genops.c:885:class_export_put()) final put ffff94ffd043c000/9b921db9-4859-438b-976e-b950f67eace4 00000020:00000080:2.0:1788918484.568380:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffd043c000/9b921db9-4859-438b-976e-b950f67eace4 for lustre-OST0001 00000020:00000080:2.0:1788918484.568474:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffd043b000 for lustre-OST0001 00000001:00100000:2.0:1788918484.570298:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00000020:00000080:2.0:1788918484.570305:0:6905:0:(genops.c:885:class_export_put()) final put ffff94ffd043f800/9b921db9-4859-438b-976e-b950f67eace4 00000020:00000080:1.0:1788918484.571334:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffd043f800/9b921db9-4859-438b-976e-b950f67eace4 for lustre-OST0000 00000020:00000080:1.0:1788918484.571371:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffd0439000 for lustre-OST0000 00010000:00010000:1.0:1788918485.526353:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918486.550579:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918487.576867:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918487.638226:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865634176:0@lo:400:kworker.0 00000100:00100000:1.0:1788918487.638287:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918487.638328:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865634176 00000100:00100000:2.0:1788918487.638337:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865634176 00000100:00100000:1.0:1788918487.638338:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865634688:0@lo:400:kworker.0 00000100:00100000:1.0:1788918487.638369:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918487.638393:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788918487.638405:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865634176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918487.638405:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788918487.638414:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865634048:0@lo:400:kworker.0 00000100:00100000:1.0:1788918487.638444:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918487.638473:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865634176:12345-0@lo:400:kworker.0 Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918487.638476:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865634560:0@lo:400:kworker.0 00000100:00100000:2.0:1788918487.638488:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788918487.638505:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918487.638525:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865634560 00000100:00100000:2.0:1788918487.638529:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865634560 00000100:00080000:3.0:1788918487.638566:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918487.638569:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788918487.638577:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865634560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918487.638638:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865634560:12345-0@lo:400:kworker.0 Request processed in 62us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918487.638643:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865634176:0@lo:400:kworker.0 00000100:00100000:2.0:1788918487.638649:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788918487.638671:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865634560:0@lo:400:kworker.0 00000100:00100000:1.0:1788918487.638691:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865634304:0@lo:400:kworker.0 00000100:00100000:1.0:1788918487.638716:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918487.639403:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865634816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918487.639432:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918487.639473:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788918487.639480:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865634816 00000100:00100000:1.0:1788918487.639482:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865634432:0@lo:400:kworker.0 00000100:00100000:2.0:1788918487.639491:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865634816 00000100:00100000:2.0:1788918487.639531:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788918487.639538:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865634816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788918487.639575:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918487.640078:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865634816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 539us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918487.640086:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788918487.640111:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788918487.642836:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788918487.642914:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7f9f80 x1875816865634816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918487.642920:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865634688 00000100:00100000:2.0:1788918487.642930:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865634688 00000100:00100000:1.0:1788918487.642943:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865634816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918487.642981:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865634432 00000100:00100000:2.0:1788918487.642985:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865634432 00000100:00100000:1.0:1788918487.642998:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788918487.643011:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865634688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918487.643033:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788918487.643043:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865634432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918487.643104:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865634432:12345-0@lo:400:kworker.0 Request processed in 63us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918487.643112:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865634688:12345-0@lo:400:kworker.0 Request processed in 103us (4741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918487.643120:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788918487.643127:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788918487.643149:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865634048 00000100:00100000:1.0:1788918487.643154:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865634048 00000100:00080000:2.0:1788918487.643163:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918487.643201:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788918487.643208:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865634048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918487.643237:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865634048:12345-0@lo:400:kworker.0 Request processed in 30us (4794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918487.643242:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788918487.643997:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865634304 00000100:00100000:3.0:1788918487.644004:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865634304 00000100:00100000:3.0:1788918487.644075:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788918487.644075:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918487.644087:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865634304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918487.644132:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865634304:12345-0@lo:400:kworker.0 Request processed in 47us (5415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918487.644139:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788918487.646192:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865634048:0@lo:400:kworker.0 00010000:00080000:1.0:1788918487.646213:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff731500 x1875816865634688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918487.646225:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865634688:0@lo:400:kworker.0 00010000:00080000:1.0:1788918487.646263:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff733100 x1875816865634432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918487.646272:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865634432:0@lo:400:kworker.0 00000100:00100000:1.0:1788918487.646292:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865634304:0@lo:400:kworker.0 00000001:02000400:0.0:1788918487.647003:0:10448:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:48:05 (1788918485) === 00000100:00100000:3.0:1788918487.955976:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918487.956214:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855117824 00000100:00100000:1.0:1788918487.956224:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855117824 00000100:00100000:1.0:1788918487.956306:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 197 00000100:00100000:1.0:1788918487.956315:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+10:7948:x1875816855117824:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788918487.956331:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918487.956347:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1492400/0x2811b8b2b0ac8d75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f02f1 expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918487.956376:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1492400/0x2811b8b2b0ac8d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02f1 expref: 11 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918487.956387:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1492400/0x2811b8b2b0ac8d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02f1 expref: 11 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918487.956396:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1492400, rc 0) 00000100:00100000:1.0:1788918487.956458:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+11:7948:x1875816855117824:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 144us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918487.956465:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 197 00000100:00100000:0.0:1788918487.961397:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918487.961468:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855117952 00000100:00100000:2.0:1788918487.961479:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855117952 00000100:00100000:2.0:1788918487.961536:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 198 00000100:00100000:2.0:1788918487.961547:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+11:7948:x1875816855117952:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788918487.961691:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+11:7948:x1875816855117952:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 145us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918487.961699:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 198 00000100:00100000:0.0:1788918487.970128:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918487.970224:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855118080 00000100:00100000:1.0:1788918487.970234:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855118080 00000100:00100000:1.0:1788918487.970292:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 199 00000100:00100000:1.0:1788918487.970302:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+11:7948:x1875816855118080:12345-192.168.202.49@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788918487.970457:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+11:7948:x1875816855118080:12345-192.168.202.49@tcp:503:mount.lustre.0 Request processed in 156us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918487.970465:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 199 00000100:00100000:3.0:1788918487.973074:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918487.973339:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855118208 00000100:00100000:2.0:1788918487.973349:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855118208 00000100:00100000:2.0:1788918487.973417:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 200 00000100:00100000:2.0:1788918487.973427:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+11:7952:x1875816855118208:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788918487.973570:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+11:7952:x1875816855118208:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 143us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918487.973578:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 200 00000100:00100000:0.0:1788918487.993069:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918487.993193:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855118336 00000100:00100000:3.0:1788918487.993203:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855118336 00000100:00100000:3.0:1788918487.993260:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 201 00000100:00100000:3.0:1788918487.993269:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+11:7952:x1875816855118336:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788918487.993558:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+11:7952:x1875816855118336:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 289us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918487.993566:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 201 00000100:00100000:0.0:1788918487.999113:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918487.999206:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855118464 00000100:00100000:1.0:1788918487.999216:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855118464 00000100:00100000:1.0:1788918487.999330:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 202 00000100:00100000:1.0:1788918487.999340:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+11:7948:x1875816855118464:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788918487.999358:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918487.999376:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1492e00/0x2811b8b2b0ac8d7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f031b expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918487.999405:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1492e00/0x2811b8b2b0ac8d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f031b expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918487.999417:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1492e00/0x2811b8b2b0ac8d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f031b expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918487.999426:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1492e00, rc 0) 00000100:00100000:1.0:1788918487.999481:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+12:7948:x1875816855118464:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 144us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918487.999486:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 202 00000100:00100000:0.0:1788918488.005847:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918488.006008:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855118592 00000100:00100000:3.0:1788918488.006058:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855118592 00000100:00100000:3.0:1788918488.006117:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 203 00000100:00100000:3.0:1788918488.006127:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+12:7948:x1875816855118592:12345-192.168.202.49@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788918488.006151:0:5918:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788918488.006175:0:5918:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788918488.006179:0:5918:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788918488.006187:0:5918:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788918488.006189:0:5918:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788918488.009473:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+12:7948:x1875816855118592:12345-192.168.202.49@tcp:256:mount.lustre.0 Request processed in 3337us (3624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918488.009486:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 203 00000100:00100000:0.0:1788918488.014362:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918488.014631:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855118720 00000100:00100000:1.0:1788918488.014641:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855118720 00000100:00100000:1.0:1788918488.014761:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 204 00000100:00100000:1.0:1788918488.014772:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+12:7948:x1875816855118720:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788918488.014788:0:5916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918488.014813:0:5916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc1492600/0x2811b8b2b0ac8d83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f0322 expref: -99 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918488.014842:0:5916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc1492600/0x2811b8b2b0ac8d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0322 expref: 13 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918488.014886:0:5916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc1492600/0x2811b8b2b0ac8d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0322 expref: 13 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918488.014896:0:5916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc1492600, rc 0) 00000100:00100000:1.0:1788918488.014952:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:7948:x1875816855118720:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 183us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918488.014959:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 204 00000100:00100000:0.0:1788918488.017772:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918488.017914:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855118848 00000100:00100000:3.0:1788918488.017937:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855118848 00000100:00100000:3.0:1788918488.017990:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 205 00000100:00100000:3.0:1788918488.018186:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:7948:x1875816855118848:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788918488.018328:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:7948:x1875816855118848:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 329us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918488.018337:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 205 00000100:00100000:0.0:1788918488.021453:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918488.021626:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855118976 00000100:00100000:1.0:1788918488.021637:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855118976 00000100:00100000:1.0:1788918488.021697:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 206 00000100:00100000:1.0:1788918488.021707:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:7948:x1875816855118976:12345-192.168.202.49@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788918488.022858:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:7948:x1875816855118976:12345-192.168.202.49@tcp:503:mount.lustre.0 Request processed in 1149us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918488.022868:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 206 00000100:00100000:0.0:1788918488.027496:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918488.027647:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855119104 00000100:00100000:2.0:1788918488.027658:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855119104 00000100:00100000:2.0:1788918488.027750:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 207 00000100:00100000:2.0:1788918488.027760:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:7956:x1875816855119104:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788918488.028224:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:7956:x1875816855119104:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 464us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918488.028232:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 207 00000100:00100000:0.0:1788918488.031189:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918488.031806:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855119232 00000100:00100000:1.0:1788918488.031816:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855119232 00000100:00100000:1.0:1788918488.031979:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 208 00000100:00100000:1.0:1788918488.031990:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:7956:x1875816855119232:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788918488.032220:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:7956:x1875816855119232:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 232us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918488.032228:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 208 00000100:00100000:0.0:1788918488.041781:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918488.041869:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918488.042490:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855119744 00000100:00100000:2.0:1788918488.042502:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855119744 00000100:00100000:2.0:1788918488.042619:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855119360 00000100:00100000:2.0:1788918488.042623:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855119360 00000100:00100000:2.0:1788918488.042638:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:2.0:1788918488.042647:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2350:x1875816855119744:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918488.042722:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2350:x1875816855119744:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 75us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918488.042730:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:2.0:1788918488.042748:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:2.0:1788918488.042753:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1875816855119360:12345-192.168.202.49@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788918488.042774:0:5925:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5f5e9986-ae14-4727-8c8d-118c4f66c180@192.168.202.49@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1788918488.042806:0:5925:0:(genops.c:1385:class_connect()) connect: client 5f5e9986-ae14-4727-8c8d-118c4f66c180, cookie 0x2811b8b2b0ac8d8a 00000004:00100000:2.0:1788918488.042843:0:5925:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788918488.043399:0:5925:0:(import.c:65:import_set_state_nolock()) ffff94ffff793000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788918488.043488:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2348:x1875816855119360:12345-192.168.202.49@tcp:38:mount.lustre.0 Request processed in 732us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918488.043495:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00080000:0.0:1788918488.044337:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918488.046113:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918488.046158:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918488.046221:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855119488 00000100:00100000:1.0:1788918488.046229:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855119488 00000100:00100000:1.0:1788918488.046276:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855119616 00000100:00100000:1.0:1788918488.046279:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855119616 00000100:00100000:1.0:1788918488.046307:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:1.0:1788918488.046366:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+7:0:x1875816855119488:12345-192.168.202.49@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788918488.046392:0:5924:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1788918488.046462:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+7:0:x1875816855119488:12345-192.168.202.49@tcp:41:mount.lustre.0 Request processed in 98us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918488.046469:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:1.0:1788918488.046485:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:1.0:1788918488.046491:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:7948:x1875816855119616:12345-192.168.202.49@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788918488.046499:0:5924:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1788918488.046513:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:7948:x1875816855119616:12345-192.168.202.49@tcp:41:mount.lustre.0 Request processed in 23us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918488.046517:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00080000:0.0:1788918488.046950:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918488.054196:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918488.055854:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855119872 00000100:00100000:3.0:1788918488.055866:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855119872 00000100:00100000:2.0:1788918488.056066:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:2.0:1788918488.056076:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:7948:x1875816855119872:12345-192.168.202.49@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788918488.056165:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:7948:x1875816855119872:12345-192.168.202.49@tcp:40:mount.lustre.0 Request processed in 90us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918488.056173:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:2.0:1788918488.058394:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918488.059214:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855120256 00000100:00100000:3.0:1788918488.059223:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855120256 00000100:00100000:3.0:1788918488.059276:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:3.0:1788918488.059285:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:7948:x1875816855120256:12345-192.168.202.49@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788918488.059364:0:5927:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788918488.059429:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:7948:x1875816855120256:12345-192.168.202.49@tcp:33:mount.lustre.0 Request processed in 145us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918488.059436:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:0.0:1788918488.060244:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918488.060342:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918488.060487:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855120000 00000100:00100000:1.0:1788918488.060493:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855120000 00000100:00100000:1.0:1788918488.060528:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855120128 00000100:00100000:1.0:1788918488.060531:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855120128 00000100:00100000:1.0:1788918488.060557:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:1.0:1788918488.060563:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875816855120000:12345-192.168.202.49@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788918488.060598:0:6912:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5f5e9986-ae14-4727-8c8d-118c4f66c180@192.168.202.49@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1788918488.060631:0:6912:0:(genops.c:1385:class_connect()) connect: client 5f5e9986-ae14-4727-8c8d-118c4f66c180, cookie 0x2811b8b2b0ac8d91 00002000:00100000:1.0:1788918488.060642:0:6912:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5f5e9986-ae14-4727-8c8d-118c4f66c180/ffff94ffd043b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788918488.060658:0:6912:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788918488.060743:0:6912:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788918488.060770:0:6912:0:(import.c:65:import_set_state_nolock()) ffff94ffd0438000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788918488.060824:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2348:x1875816855120000:12345-192.168.202.49@tcp:8:mount.lustre.0 Request processed in 258us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918488.060830:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:1.0:1788918488.060846:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:1.0:1788918488.060850:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875816855120128:12345-192.168.202.49@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788918488.060864:0:6912:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5f5e9986-ae14-4727-8c8d-118c4f66c180@192.168.202.49@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1788918488.060881:0:6912:0:(genops.c:1385:class_connect()) connect: client 5f5e9986-ae14-4727-8c8d-118c4f66c180, cookie 0x2811b8b2b0ac8d98 00002000:00100000:1.0:1788918488.060886:0:6912:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5f5e9986-ae14-4727-8c8d-118c4f66c180/ffff94ffd043b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788918488.061615:0:6912:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788918488.061661:0:6912:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788918488.061680:0:6912:0:(import.c:65:import_set_state_nolock()) ffff94ffd043e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788918488.061859:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2348:x1875816855120128:12345-192.168.202.49@tcp:8:mount.lustre.0 Request processed in 1005us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918488.061867:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:2.0:1788918488.155189:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865634944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788918488.155247:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918488.155537:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865634944 00000100:00100000:0.0:1788918488.155546:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865634944 00000100:00100000:0.0:1788918488.155623:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788918488.155633:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865634944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788918488.155656:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918488.156098:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865634944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 466us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918488.156124:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788918488.156379:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d98380 x1875816865634944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918488.156399:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865634944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788918488.599113:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918489.623527:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918490.646230:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788918491.612154:0:10641:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788918491.672748:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918492.698514:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918492.758500:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865635200:0@lo:400:kworker.0 00000100:00100000:3.0:1788918492.758523:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865635328:0@lo:400:kworker.0 00000100:00100000:1.0:1788918492.758580:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918492.758595:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865635456:0@lo:400:kworker.0 00000100:00100000:3.0:1788918492.758623:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918492.758644:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865635712:0@lo:400:kworker.0 00000100:00100000:1.0:1788918492.758666:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918492.758681:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788918492.758684:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865635072:0@lo:400:kworker.0 00000100:00100000:1.0:1788918492.758702:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918492.758722:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865635584:0@lo:400:kworker.0 00000100:00100000:0.0:1788918492.758742:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865635200 00000100:00100000:0.0:1788918492.758764:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865635200 00000100:00100000:0.0:1788918492.758803:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788918492.758811:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865635200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918492.758846:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918492.758865:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865635200:12345-0@lo:400:kworker.0 Request processed in 53us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918492.758873:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788918492.758888:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865635584 00000100:00100000:0.0:1788918492.758891:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865635584 00000100:00100000:1.0:1788918492.758892:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865635200:0@lo:400:kworker.0 00000100:00100000:0.0:1788918492.758917:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788918492.758924:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865635584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918492.758951:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865635584:12345-0@lo:400:kworker.0 Request processed in 28us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918492.758958:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788918492.758981:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918492.758984:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788918492.758992:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865635840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918492.758999:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918492.759051:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918492.759052:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865635328 00000100:00100000:0.0:1788918492.759056:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865635328 00000100:00100000:2.0:1788918492.759081:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865635840 00000100:00100000:2.0:1788918492.759085:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865635840 00000100:00100000:0.0:1788918492.759090:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788918492.759098:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865635328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918492.759116:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788918492.759124:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865635840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918492.759135:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865635328:12345-0@lo:400:kworker.0 Request processed in 37us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918492.759142:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00002000:00000024:2.0:1788918492.759144:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:0.0:1788918492.759168:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788918492.759172:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918492.759179:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865635840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918492.759193:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788918492.759194:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865635328:0@lo:400:kworker.0 00010000:00080000:2.0:1788918492.759229:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7fb800 x1875816865635840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918492.759230:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865635072 00000100:00100000:0.0:1788918492.759234:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865635072 00000100:00100000:2.0:1788918492.759246:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865635840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918492.759264:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788918492.759273:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865635072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918492.759300:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865635072:12345-0@lo:400:kworker.0 Request processed in 30us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918492.759306:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788918492.759339:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865635072:0@lo:400:kworker.0 00000100:00100000:0.0:1788918492.759349:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865635584:0@lo:400:kworker.0 00000100:00100000:3.0:1788918492.759557:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865635456 00000100:00100000:3.0:1788918492.759562:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865635456 00000100:00100000:3.0:1788918492.759600:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865635712 00000100:00100000:3.0:1788918492.759603:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865635712 00000100:00100000:3.0:1788918492.759619:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788918492.759624:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865635456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918492.759661:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865635456:12345-0@lo:400:kworker.0 Request processed in 37us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918492.759668:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788918492.759679:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788918492.759685:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865635712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918492.759711:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865635712:12345-0@lo:400:kworker.0 Request processed in 27us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918492.759716:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788918492.759738:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff77ca80 x1875816865635712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918492.759748:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865635712:0@lo:400:kworker.0 00000100:00080000:0.0:1788918492.759880:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788918492.760012:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefd1b800 x1875816865635456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918492.760040:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865635456:0@lo:400:kworker.0 00000100:00100000:2.0:1788918493.270129:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788918493.270162:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865635968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788918493.270224:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918493.270266:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865635968 00000100:00100000:0.0:1788918493.270274:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865635968 00000100:00100000:0.0:1788918493.270336:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788918493.270346:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865635968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788918493.270373:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918493.270474:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865635968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918493.270482:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788918493.271177:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7fb800 x1875816865635968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918493.271196:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865635968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918493.370302:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918493.370381:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918493.370420:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918493.370453:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918493.370488:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918493.370525:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855120896 00000100:00100000:1.0:1788918493.370534:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855120896 00000100:00100000:1.0:1788918493.370605:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855120768 00000100:00100000:1.0:1788918493.370609:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855120768 00000100:00100000:1.0:1788918493.370638:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:1.0:1788918493.370649:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2352:x1875816855120896:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918493.370723:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2352:x1875816855120896:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 76us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918493.370732:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:1.0:1788918493.370754:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:1.0:1788918493.370762:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2352:x1875816855120768:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918493.370792:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2352:x1875816855120768:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918493.370800:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:1.0:1788918493.370823:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855120640 00000100:00100000:1.0:1788918493.370827:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855120640 00000100:00100000:1.0:1788918493.370857:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855120512 00000100:00100000:1.0:1788918493.370859:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855120512 00000100:00100000:1.0:1788918493.370874:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:1.0:1788918493.370893:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2352:x1875816855120640:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918493.370923:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2352:x1875816855120640:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 32us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918493.370930:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:1.0:1788918493.370943:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:1.0:1788918493.370949:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855120512:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918493.370969:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855120512:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 20us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918493.370975:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00080000:1.0:1788918493.370993:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788918493.370997:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788918493.370999:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788918493.371876:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855120384 00000100:00100000:3.0:1788918493.371883:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855120384 00000100:00100000:3.0:1788918493.371954:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 210 00000100:00100000:3.0:1788918493.371963:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855120384:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918493.371995:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855120384:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 35us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918493.372002:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 210 00010000:00010000:1.0:1788918493.719215:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788918493.785249:0:7980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f5e9986-ae14-4727-8c8d-118c4f66c180 00000001:00100000:1.0:1788918493.787964:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f5e9986-ae14-4727-8c8d-118c4f66c180 00000001:00100000:1.0:1788918493.796692:0:5903:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5f5e9986-ae14-4727-8c8d-118c4f66c180 00010000:00010000:0.0:1788918494.742205:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918495.768475:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918496.790435:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788918497.010130:0:10903:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788918497.010497:0:10903:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788918497.815886:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918497.878519:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865636096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918497.880150:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918497.880775:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865636224:0@lo:400:kworker.0 00000100:00100000:3.0:1788918497.880831:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918497.880865:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865636736:0@lo:400:kworker.0 00000100:00100000:3.0:1788918497.880889:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918497.881001:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865636224 00000100:00100000:1.0:1788918497.881009:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865636224 00000100:00100000:1.0:1788918497.881090:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788918497.881110:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865636224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918497.881157:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865636224:12345-0@lo:400:kworker.0 Request processed in 59us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918497.881164:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788918497.881612:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865636736 00000100:00100000:1.0:1788918497.881630:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865636736 00000100:00100000:1.0:1788918497.881664:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788918497.881671:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865636736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918497.881705:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865636736:12345-0@lo:400:kworker.0 Request processed in 34us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918497.881712:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788918497.881727:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918497.882108:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865636096 00000100:00100000:2.0:1788918497.882113:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865636096 00000100:00100000:2.0:1788918497.882156:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788918497.882163:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865636096:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788918497.882310:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788918497.882421:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918497.882465:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865636096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 302us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918497.882471:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788918497.882565:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865636480:0@lo:400:kworker.0 00000100:00100000:0.0:1788918497.882601:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918497.882647:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865636608:0@lo:400:kworker.0 00000100:00100000:0.0:1788918497.882673:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788918497.882707:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7fb800 x1875816865636096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918497.882726:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865636096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918497.882766:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865636224:0@lo:400:kworker.0 00000100:00100000:0.0:1788918497.882776:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865636736:0@lo:400:kworker.0 00000100:00100000:3.0:1788918497.882825:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865636352:0@lo:400:kworker.0 00000100:00100000:3.0:1788918497.882853:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918497.882935:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865636608 00000100:00100000:1.0:1788918497.882940:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865636608 00000100:00100000:1.0:1788918497.882981:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788918497.882988:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865636608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918497.883051:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865636608:12345-0@lo:400:kworker.0 Request processed in 63us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918497.883058:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788918497.883331:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788918497.883454:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865636480 00000100:00100000:2.0:1788918497.883459:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865636480 00000100:00100000:2.0:1788918497.883514:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865636352 00000100:00100000:2.0:1788918497.883528:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865636352 00000100:00100000:2.0:1788918497.883547:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788918497.883554:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865636480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918497.883595:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865636480:12345-0@lo:400:kworker.0 Request processed in 42us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918497.883601:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788918497.883613:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788918497.883619:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865636352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918497.883652:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865636352:12345-0@lo:400:kworker.0 Request processed in 33us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918497.884408:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788918497.884454:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865636352:0@lo:400:kworker.0 00000100:00100000:2.0:1788918497.884483:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865636480:0@lo:400:kworker.0 00010000:00080000:0.0:1788918497.884589:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff731500 x1875816865636608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918497.884600:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865636608:0@lo:400:kworker.0 00000100:00080000:3.0:1788918497.884759:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918498.390410:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865636864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918498.390476:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918498.390843:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865636864 00000100:00100000:2.0:1788918498.390852:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865636864 00000100:00100000:2.0:1788918498.390906:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788918498.390916:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865636864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918498.390945:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918498.390997:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865636864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918498.391004:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788918498.391225:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7fb480 x1875816865636864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918498.391245:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865636864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918498.479974:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918498.480048:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918498.480078:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918498.480105:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918498.480145:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918498.480174:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855121536 00000100:00100000:1.0:1788918498.480195:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855121536 00000100:00100000:1.0:1788918498.480248:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855121408 00000100:00100000:1.0:1788918498.480251:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855121408 00000100:00100000:1.0:1788918498.480270:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:1.0:1788918498.480280:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855121536:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918498.480359:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855121536:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918498.480366:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:1.0:1788918498.480392:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:1.0:1788918498.480398:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855121408:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918498.480422:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855121408:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 25us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918498.480429:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:1.0:1788918498.480446:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855121280 00000100:00100000:1.0:1788918498.480449:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855121280 00000100:00100000:1.0:1788918498.480472:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855121152 00000100:00100000:1.0:1788918498.480475:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855121152 00000100:00100000:1.0:1788918498.480488:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:1.0:1788918498.480509:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855121280:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918498.480534:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855121280:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 41us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918498.480540:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:1.0:1788918498.480550:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00100000:1.0:1788918498.480555:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855121152:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918498.480575:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855121152:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 20us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918498.480581:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00080000:1.0:1788918498.480598:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788918498.480603:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788918498.480604:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788918498.481045:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855121024 00000100:00100000:3.0:1788918498.481051:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855121024 00000100:00100000:3.0:1788918498.481088:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 212 00000100:00100000:3.0:1788918498.481095:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855121024:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918498.481128:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855121024:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 34us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918498.481135:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 212 00010000:00010000:0.0:1788918498.838137:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788918499.618899:0:11000:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788918499.619179:0:11000:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788918499.870004:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918500.886655:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918501.910213:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788918502.522410:0:11097:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788918502.522941:0:11097:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788918502.934895:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918502.998825:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865637376:0@lo:400:kworker.0 00000100:00100000:2.0:1788918502.998930:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918502.998980:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865636992:0@lo:400:kworker.0 00000100:00100000:0.0:1788918502.999104:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918502.999105:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865637376 00000100:00100000:2.0:1788918502.999117:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865637376 00000100:00100000:0.0:1788918502.999160:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865637504:0@lo:400:kworker.0 00000100:00100000:0.0:1788918502.999194:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918502.999203:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788918502.999218:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865637376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918502.999248:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865637248:0@lo:400:kworker.0 00000100:00080000:3.0:1788918502.999410:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788918502.999468:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff77e680 x1875816865637376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918502.999482:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865637376:0@lo:400:kworker.0 00000100:00100000:3.0:1788918502.999633:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865636992 00000100:00100000:3.0:1788918502.999640:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865636992 00000100:00100000:0.0:1788918502.999813:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918502.999843:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865637760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918502.999888:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918502.999908:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788918502.999914:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865637120:0@lo:400:kworker.0 00000100:00100000:0.0:1788918502.999935:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918502.999953:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865637632:0@lo:400:kworker.0 00000100:00100000:0.0:1788918502.999973:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918502.999999:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865637504 00000100:00100000:0.0:1788918503.000003:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865637504 00000100:00100000:0.0:1788918503.000071:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865637248 00000100:00100000:0.0:1788918503.000074:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865637248 00000100:00100000:0.0:1788918503.000085:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865637120 00000100:00100000:0.0:1788918503.000087:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865637120 00000100:00100000:0.0:1788918503.000100:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788918503.000108:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865637504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918503.000155:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865637504:12345-0@lo:400:kworker.0 Request processed in 47us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918503.000162:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788918503.000179:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788918503.000185:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865637248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918503.000215:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865637248:12345-0@lo:400:kworker.0 Request processed in 30us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918503.000221:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788918503.000232:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788918503.000238:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865637120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918503.000265:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865637120:12345-0@lo:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918503.000270:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788918503.000299:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865637760 00000100:00100000:0.0:1788918503.000302:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865637760 00000100:00100000:0.0:1788918503.000326:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788918503.000333:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865637760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788918503.000354:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918503.000386:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865637760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918503.000391:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788918503.000410:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865637632 00000100:00100000:0.0:1788918503.000414:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865637632 00000100:00100000:0.0:1788918503.000436:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788918503.000441:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865637632:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788918503.000578:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788918503.000588:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918503.000633:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865637504:0@lo:400:kworker.0 00000100:00100000:1.0:1788918503.000676:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865637120:0@lo:400:kworker.0 00010000:00080000:1.0:1788918503.000708:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff77fb80 x1875816865637760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918503.000729:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865637760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918503.000744:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865637248:0@lo:400:kworker.0 00000100:00100000:3.0:1788918503.003266:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788918503.003281:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865636992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918503.003527:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865637376:12345-0@lo:400:kworker.0 Request processed in 4305us (4589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918503.003544:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788918503.007691:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865636992:12345-0@lo:400:kworker.0 Request processed in 4395us (8571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918503.007705:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788918503.007863:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865636992:0@lo:400:kworker.0 00000100:00100000:0.0:1788918503.008366:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865637632:12345-0@lo:400:kworker.0 Request processed in 7921us (8388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918503.008377:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788918503.009289:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff77df80 x1875816865637632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918503.009304:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865637632:0@lo:400:kworker.0 00000100:00100000:1.0:1788918503.512823:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865637888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918503.512905:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918503.513762:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865637888 00000100:00100000:2.0:1788918503.513772:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865637888 00000100:00100000:2.0:1788918503.513827:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788918503.513837:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865637888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918503.513876:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918503.513934:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865637888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918503.513940:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788918503.514100:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7f8e00 x1875816865637888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918503.514119:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865637888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918503.606786:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918503.606847:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918503.606901:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918503.606927:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918503.606952:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918503.606984:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855121664 00000100:00100000:1.0:1788918503.606993:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855121664 00000100:00100000:1.0:1788918503.607065:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 214 00000100:00100000:1.0:1788918503.607075:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855121664:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918503.607140:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855121664:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 66us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918503.607154:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 214 00000100:00100000:1.0:1788918503.607187:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855121792 00000100:00100000:1.0:1788918503.607192:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855121792 00000100:00100000:1.0:1788918503.607226:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855121920 00000100:00100000:1.0:1788918503.607229:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855121920 00000100:00100000:1.0:1788918503.607246:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:1.0:1788918503.607254:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855121792:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918503.607285:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855121792:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 32us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918503.607291:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:1.0:1788918503.607303:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:1.0:1788918503.607310:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855121920:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918503.607331:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855121920:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 22us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918503.607337:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:1.0:1788918503.607355:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855122048 00000100:00100000:1.0:1788918503.607358:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855122048 00000100:00100000:1.0:1788918503.607381:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855122176 00000100:00100000:1.0:1788918503.607383:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855122176 00000100:00100000:1.0:1788918503.607402:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:1.0:1788918503.607408:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855122048:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918503.607432:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855122048:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 24us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918503.607438:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:1.0:1788918503.607463:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:1.0:1788918503.607477:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855122176:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918503.607503:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855122176:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 28us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918503.607509:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00080000:0.0:1788918503.607928:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788918503.607932:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788918503.607934:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788918503.971572:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918504.983011:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918506.006814:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788918506.355436:0:11195:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788918506.355652:0:11195:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788918507.030249:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918508.066470:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918508.119236:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865638016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918508.119437:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918508.119485:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865638016 00000100:00100000:0.0:1788918508.119493:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865638016 00000100:00100000:0.0:1788918508.119569:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788918508.119579:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865638016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788918508.119607:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918508.119652:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865638016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918508.119659:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788918508.119686:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefcb1500 x1875816865638016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918508.119704:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865638016:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788918508.119802:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788918508.120548:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865638272:0@lo:400:kworker.0 00000100:00100000:0.0:1788918508.120585:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918508.120608:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788918508.120615:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865638144:0@lo:400:kworker.0 00000100:00100000:0.0:1788918508.120643:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918508.120668:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865638656:0@lo:400:kworker.0 00000100:00100000:0.0:1788918508.120688:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918508.120713:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865638272 00000100:00100000:0.0:1788918508.120717:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865638272 00000100:00100000:0.0:1788918508.120744:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865638656 00000100:00100000:0.0:1788918508.120747:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865638656 00000100:00100000:0.0:1788918508.120768:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788918508.120775:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865638272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918508.120813:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865638272:12345-0@lo:400:kworker.0 Request processed in 38us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918508.120819:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788918508.120833:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788918508.120840:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865638656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918508.120867:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865638656:12345-0@lo:400:kworker.0 Request processed in 28us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918508.120873:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788918508.120896:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865638400:0@lo:400:kworker.0 00000100:00100000:0.0:1788918508.120920:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918508.120937:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788918508.120943:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865638528:0@lo:400:kworker.0 00000100:00100000:0.0:1788918508.120965:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918508.120997:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865638528 00000100:00100000:0.0:1788918508.121001:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865638528 00000100:00100000:0.0:1788918508.121050:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788918508.121057:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865638528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918508.121091:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865638528:12345-0@lo:400:kworker.0 Request processed in 35us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918508.121097:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788918508.121113:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788918508.121117:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788918508.121135:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94fff692c380 x1875816865638528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918508.121146:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865638528:0@lo:400:kworker.0 00000100:00100000:0.0:1788918508.121169:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865638656:0@lo:400:kworker.0 00000100:00100000:0.0:1788918508.121178:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865638272:0@lo:400:kworker.0 00000100:00100000:0.0:1788918508.121196:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865638400 00000100:00100000:0.0:1788918508.121198:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865638400 00000100:00100000:0.0:1788918508.121235:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788918508.121241:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865638400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918508.121340:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865638144 00000100:00100000:3.0:1788918508.121344:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865638144 00000100:00100000:3.0:1788918508.121385:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00080000:1.0:1788918508.121390:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918508.121392:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865638144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918508.121450:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865638144:12345-0@lo:400:kworker.0 Request processed in 59us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918508.121457:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788918508.121495:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865638144:0@lo:400:kworker.0 00000100:00100000:0.0:1788918508.121545:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865638400:12345-0@lo:400:kworker.0 Request processed in 304us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918508.121613:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865638400:0@lo:400:kworker.0 00000100:00100000:0.0:1788918508.121845:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788918508.632053:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865638784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788918508.632121:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918508.632194:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865638784 00000100:00100000:2.0:1788918508.632206:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865638784 00000100:00100000:2.0:1788918508.632267:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788918508.632276:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865638784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918508.632308:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918508.632356:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865638784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918508.632363:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788918508.632414:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7fb100 x1875816865638784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918508.632432:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865638784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788918508.725770:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918508.725812:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918508.725830:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918508.725847:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918508.725861:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918508.725888:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855122688 00000100:00100000:0.0:1788918508.725896:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855122688 00000100:00100000:0.0:1788918508.725939:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855122816 00000100:00100000:0.0:1788918508.725941:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855122816 00000100:00100000:0.0:1788918508.725962:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:0.0:1788918508.725973:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2348:x1875816855122688:12345-192.168.202.49@tcp:9:kworker.0 00000100:00100000:2.0:1788918508.725979:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:2.0:1788918508.725994:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2348:x1875816855122816:12345-192.168.202.49@tcp:9:kworker.0 00000020:00000080:0.0:1788918508.726002:0:6911:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8d91 00000020:00000080:2.0:1788918508.726012:0:7258:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8d98 00000100:00080000:0.0:1788918508.726012:0:6911:0:(import.c:65:import_set_state_nolock()) ffff94ffd0438000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788918508.726041:0:7258:0:(import.c:65:import_set_state_nolock()) ffff94ffd043e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788918508.726086:0:6911:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:2.0:1788918508.726088:0:7258:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788918508.726263:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+2:2348:x1875816855122688:12345-192.168.202.49@tcp:9:kworker.0 Request processed in 293us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918508.726274:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:2.0:1788918508.726275:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+2:2348:x1875816855122816:12345-192.168.202.49@tcp:9:kworker.0 Request processed in 282us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918508.726287:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:0.0:1788918508.726294:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855122560 00000100:00100000:0.0:1788918508.726298:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855122560 00010000:00010000:2.0:1788918508.726313:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918508.726326:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855122432 00000100:00100000:0.0:1788918508.726329:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855122432 00000100:00100000:0.0:1788918508.726344:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:0.0:1788918508.726350:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855122560:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918508.726377:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855122560:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 28us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918508.726382:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:0.0:1788918508.726390:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:0.0:1788918508.726394:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855122432:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918508.726434:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855122432:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 32us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918508.726441:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00080000:0.0:1788918508.726461:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788918508.726472:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788918508.726474:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788918508.726484:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918508.728417:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855122304 00000100:00100000:3.0:1788918508.728429:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855122304 00000100:00100000:3.0:1788918508.728523:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 216 00000100:00100000:3.0:1788918508.728534:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855122304:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918508.728680:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855122304:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 147us (2864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918508.728688:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 216 00010000:00010000:2.0:1788918509.078513:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918510.105897:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918511.134405:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788918511.384690:0:11340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788918512.151356:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918513.174466:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918513.238415:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865638912:0@lo:400:kworker.0 00000100:00100000:1.0:1788918513.238513:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918513.238686:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865639040:0@lo:400:kworker.0 00000100:00100000:0.0:1788918513.238724:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918513.238792:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865639424:0@lo:400:kworker.0 00000100:00100000:1.0:1788918513.238818:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918513.238928:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865638912 00000100:00100000:2.0:1788918513.238937:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865638912 00000100:00100000:2.0:1788918513.238994:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788918513.239005:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865638912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918513.239087:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865638912:12345-0@lo:400:kworker.0 Request processed in 84us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918513.239114:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788918513.239153:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865639168:0@lo:400:kworker.0 00000100:00100000:2.0:1788918513.239180:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918513.239213:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788918513.239219:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865639296:0@lo:400:kworker.0 00000100:00100000:2.0:1788918513.239247:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918513.239391:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865639296 00000100:00100000:3.0:1788918513.239397:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865639296 00000100:00100000:3.0:1788918513.239442:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788918513.239450:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865639296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918513.239489:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865639296:12345-0@lo:400:kworker.0 Request processed in 40us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918513.239504:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788918513.239541:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865638912:0@lo:400:kworker.0 00000100:00100000:3.0:1788918513.239568:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788918513.239577:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865639680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918513.239607:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788918513.239644:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff77c380 x1875816865639296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918513.239656:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865639296:0@lo:400:kworker.0 00000100:00100000:3.0:1788918513.239687:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865639680 00000100:00100000:3.0:1788918513.239691:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865639680 00000100:00100000:3.0:1788918513.239721:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788918513.239728:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865639680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788918513.239755:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918513.239793:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865639680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918513.239800:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788918513.239824:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7fb480 x1875816865639680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918513.239839:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865639680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918513.240143:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865639552:0@lo:400:kworker.0 00000100:00100000:0.0:1788918513.240186:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918513.240279:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865639040 00000100:00100000:1.0:1788918513.240284:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865639040 00000100:00100000:1.0:1788918513.240310:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865639424 00000100:00100000:1.0:1788918513.240313:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865639424 00000100:00100000:1.0:1788918513.240326:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865639168 00000100:00100000:1.0:1788918513.240328:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865639168 00000100:00100000:1.0:1788918513.240342:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788918513.240509:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865639040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918513.240550:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865639040:12345-0@lo:400:kworker.0 Request processed in 44us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918513.240580:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865639552 00000100:00100000:3.0:1788918513.240584:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865639552 00000100:00100000:3.0:1788918513.240608:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788918513.240615:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865639552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918513.240645:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865639552:12345-0@lo:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918513.240731:0:5924:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788918513.240742:0:5924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788918513.240873:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788918513.241182:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788918513.241192:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865639424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918513.241265:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865639424:12345-0@lo:400:kworker.0 Request processed in 75us (2445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918513.241272:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788918513.241287:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788918513.241294:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865639168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918513.241328:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865639168:12345-0@lo:400:kworker.0 Request processed in 34us (2147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918513.241333:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788918513.241370:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788918513.241375:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788918513.241378:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788918513.241416:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865639168:0@lo:400:kworker.0 00000100:00100000:0.0:1788918513.241448:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865639424:0@lo:400:kworker.0 00000100:00100000:0.0:1788918513.241479:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865639040:0@lo:400:kworker.0 00010000:00080000:0.0:1788918513.241491:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff77f480 x1875816865639552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918513.241509:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865639552:0@lo:400:kworker.0 00000100:00100000:1.0:1788918513.241674:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788918513.755475:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865639808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788918513.755566:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918513.755830:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865639808 00000100:00100000:3.0:1788918513.755838:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865639808 00000100:00100000:3.0:1788918513.755891:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788918513.755900:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865639808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788918513.755938:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918513.755985:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865639808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918513.755992:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788918513.756068:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff77c380 x1875816865639808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918513.756088:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865639808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788918513.840959:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918513.840998:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918513.841065:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918513.841482:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855123200 00000100:00100000:2.0:1788918513.841493:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855123200 00000100:00100000:2.0:1788918513.841553:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855123072 00000100:00100000:2.0:1788918513.841557:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855123072 00000100:00100000:2.0:1788918513.841582:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:2.0:1788918513.841592:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2352:x1875816855123200:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918513.841669:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2352:x1875816855123200:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 78us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918513.841677:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:2.0:1788918513.841698:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 71 00000100:00100000:2.0:1788918513.841707:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855123072:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918513.841732:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855123072:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 28us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918513.841739:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 71 00000100:00080000:2.0:1788918513.841877:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918513.842434:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855122944 00000100:00100000:3.0:1788918513.842440:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855122944 00000100:00100000:3.0:1788918513.842501:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 218 00000100:00100000:3.0:1788918513.842509:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855122944:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918513.842556:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855122944:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 47us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918513.842562:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 218 00010000:00010000:0.0:1788918514.198159:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788918514.927975:0:7980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f5e9986-ae14-4727-8c8d-118c4f66c180 00000020:00000080:0.0:1788918514.927985:0:7980:0:(genops.c:885:class_export_put()) final put ffff94ffd043b800/5f5e9986-ae14-4727-8c8d-118c4f66c180 00000001:00100000:0.0:1788918514.928046:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f5e9986-ae14-4727-8c8d-118c4f66c180 00000020:00000080:0.0:1788918514.928050:0:6905:0:(genops.c:885:class_export_put()) final put ffff94ffd043b000/5f5e9986-ae14-4727-8c8d-118c4f66c180 00000020:00000080:3.0:1788918514.928099:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffd043b800/5f5e9986-ae14-4727-8c8d-118c4f66c180 for lustre-OST0001 00000020:00000080:3.0:1788918514.928151:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffd043b000/5f5e9986-ae14-4727-8c8d-118c4f66c180 for lustre-OST0000 00000020:00000080:3.0:1788918514.928166:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffd043e000 for lustre-OST0001 00000020:00000080:3.0:1788918514.928172:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffd0438000 for lustre-OST0000 00010000:00010000:3.0:1788918515.222943:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788918516.198339:0:11488:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdda50cb20 20000000:00000080:0.0:1788918516.198356:0:11488:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94ffefbe4400 uarg=0000000000000000 20000000:01000000:0.0:1788918516.198403:0:11488:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788918516.198409:0:11488:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788918516.198414:0:11488:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788918516.199292:0:11489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788918516.201401:0:11488:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788918516.216843:0:11488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788918516.221444:0:11488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918516.221472:0:11488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1493c00/0x2811b8b2b0ac8d44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ea expref: 12 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918516.221482:0:11488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fff48dd000/0x2811b8b2b0ac8d52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d4b expref: 18 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918516.221488:0:11488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d59 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918516.221507:0:11488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d67 expref: 18 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918516.221514:0:11488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc1492600/0x2811b8b2b0ac8d83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0322 expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918516.221522:0:11488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918516.221564:0:11488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1492600/0x2811b8b2b0ac8d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0322 expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918516.221580:0:11488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94ffc1492600/0x2811b8b2b0ac8d83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0322 expref: 12 pid: 5916 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918516.221595:0:11488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd46300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11488:1875816865639936:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918516.221762:0:11488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8d67 expref: 18 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918516.221771:0:11488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8d6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d67 expref: 18 pid: 5916 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918516.221780:0:11488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11488:1875816865640064:0@lo:104: 00000100:00100000:0.0:1788918516.221820:0:11488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788918516.221900:0:11488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8d59 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918516.221909:0:11488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8d60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d59 expref: 18 pid: 5917 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918516.221924:0:11488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd44e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11488:1875816865640192:0@lo:104: 00000100:00100000:0.0:1788918516.221946:0:11488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788918516.228294:0:11488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fff48dd000/0x2811b8b2b0ac8d52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8d4b expref: 18 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918516.228337:0:11488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94fff48dd000/0x2811b8b2b0ac8d52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d4b expref: 18 pid: 5918 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918516.228352:0:11488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11488:1875816865640320:0@lo:104: 00000100:00100000:2.0:1788918516.228408:0:11488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918516.229722:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865640064 00000100:00100000:3.0:1788918516.229751:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865640064 00000100:00100000:3.0:1788918516.229793:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865640192 00000100:00100000:3.0:1788918516.229797:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865640192 00000100:00100000:3.0:1788918516.229812:0:5908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788918516.229820:0:5908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+4:11488:x1875816865640064:12345-0@lo:104: 00010000:00010000:3.0:1788918516.229834:0:5908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8d6e expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.229893:0:5908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788918516.229899:0:5908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+4:11488:x1875816865640064:12345-0@lo:104: Request processed in 80us (8079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918516.229906:0:5908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788918516.229922:0:5908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788918516.229928:0:5908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+3:11488:x1875816865640192:12345-0@lo:104: 00010000:00010000:3.0:1788918516.229935:0:5908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8d60 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.229966:0:5908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788918516.229970:0:5908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+3:11488:x1875816865640192:12345-0@lo:104: Request processed in 44us (8024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918516.229976:0:5908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788918516.230627:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:3.0:1788918516.230650:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788918516.230656:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8d6e expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.230676:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1492200 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918516.230680:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8d6e expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.230701:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8d6e expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918516.230709:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8d6e expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918516.230715:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788918516.230760:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8d6e expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.230767:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918516.230787:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8d6e expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.230794:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1492200/0x2811b8b2b0ac8d67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8d6e expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.230807:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918516.230810:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8d60 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.230815:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48ddc00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918516.230818:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8d60 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.230825:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8d60 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918516.230831:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8d60 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918516.230843:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788918516.230857:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8d60 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.230863:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918516.230869:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8d60 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.230875:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94fff48ddc00/0x2811b8b2b0ac8d59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8d60 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.230884:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918516.230886:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918516.230887:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918516.230894:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918516.230905:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855123328 00000100:00100000:3.0:1788918516.230908:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855123328 00010000:00010000:3.0:1788918516.230927:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1492600/0x2811b8b2b0ac8d83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0322 expref: 13 pid: 5916 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918516.230952:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:3.0:1788918516.230960:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5094050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2350:x1875816855123328:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918516.230969:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918516.230974:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1492600/0x2811b8b2b0ac8d83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0322 expref: 13 pid: 5916 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.230986:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1492600/0x2811b8b2b0ac8d83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0322 expref: 13 pid: 5916 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.231015:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918516.231068:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5094050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2350:x1875816855123328:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 109us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918516.231075:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:3.0:1788918516.231134:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865640448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788918516.231165:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918516.231402:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788918516.231409:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865640576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788918516.231433:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918516.231460:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865640448 00000100:00100000:3.0:1788918516.231464:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865640448 00010000:00010000:3.0:1788918516.231479:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8d6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d67 expref: 19 pid: 5916 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918516.231497:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865640576 00000100:00100000:3.0:1788918516.231500:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865640576 00010000:00010000:3.0:1788918516.231511:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8d60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d59 expref: 20 pid: 5917 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918516.231527:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788918516.231532:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+20:3419:x1875816865640448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788918516.231541:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918516.231545:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8d6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d67 expref: 20 pid: 5916 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.231554:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8d6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d67 expref: 20 pid: 5916 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.231573:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918516.231600:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+20:3419:x1875816865640448:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918516.231607:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788918516.231621:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788918516.231626:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865640576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788918516.231633:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918516.231638:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8d60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d59 expref: 19 pid: 5917 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.231647:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8d60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d59 expref: 19 pid: 5917 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.231657:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918516.233272:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865640576:12345-0@lo:103:ldlm_bl.0 Request processed in 1643us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918516.233282:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788918516.233336:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865640576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788918516.233349:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865640448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788918516.233815:0:11488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc1493c00/0x2811b8b2b0ac8d44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ea expref: 12 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918516.233831:0:11488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94ffc1493c00/0x2811b8b2b0ac8d44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ea expref: 12 pid: 5918 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918516.233843:0:11488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11488:1875816865640704:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788918516.233899:0:11488:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9f00 going to sleep for 11 seconds 00010000:00010000:2.0:1788918516.233916:0:11488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1492600/0x2811b8b2b0ac8d83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0322 expref: 12 pid: 5916 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918516.233930:0:11488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd46300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11488:1875816865639936:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918516.233940:0:11488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8d6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d67 expref: 18 pid: 5916 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918516.233948:0:11488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11488:1875816865640064:0@lo:104: 00010000:00010000:2.0:1788918516.233957:0:11488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1493400/0x2811b8b2b0ac8d60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d59 expref: 17 pid: 5917 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918516.233965:0:11488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd44e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11488:1875816865640192:0@lo:104: 00000100:00100000:3.0:1788918516.237286:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865640320 00000100:00100000:3.0:1788918516.237297:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865640320 00000100:00100000:3.0:1788918516.237356:0:5908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788918516.237365:0:5908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+3:11488:x1875816865640320:12345-0@lo:104: 00010000:00010000:3.0:1788918516.237383:0:5908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8d52 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.237489:0:5908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788918516.237496:0:5908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+3:11488:x1875816865640320:12345-0@lo:104: Request processed in 132us (9088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918516.237503:0:5908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788918516.237524:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918516.237530:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8d52 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.237536:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc800 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918516.237540:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8d52 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.237548:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8d52 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918516.237555:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8d52 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918516.237561:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788918516.237593:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8d52 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.237600:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918516.237620:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8d52 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.237627:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94fff48dc800/0x2811b8b2b0ac8d4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8d52 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.237654:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918516.237656:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918516.237766:0:11488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11488:1875816865640320:0@lo:104: 00000100:00100000:2.0:1788918516.237803:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865640832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788918516.237845:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788918516.237977:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918516.238157:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865640832 00000100:00100000:1.0:1788918516.238162:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865640832 00010000:00010000:1.0:1788918516.238199:0:8796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fff48dd000/0x2811b8b2b0ac8d52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d4b expref: 17 pid: 5918 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918516.238229:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788918516.238236:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:74aa73a2-313d-4992-b461-72ab8c3ab246+17:3417:x1875816865640832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788918516.238246:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918516.238250:0:8796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fff48dd000/0x2811b8b2b0ac8d52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d4b expref: 17 pid: 5918 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238261:0:8796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fff48dd000/0x2811b8b2b0ac8d52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d4b expref: 17 pid: 5918 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238273:0:8796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dd000/0x2811b8b2b0ac8d52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8d4b expref: 17 pid: 5918 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238285:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918516.238453:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3417:x1875816865640832:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918516.238460:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788918516.238588:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918516.238637:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855123456 00000100:00100000:1.0:1788918516.238642:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855123456 00010000:00010000:1.0:1788918516.238670:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc1493c00/0x2811b8b2b0ac8d44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ea expref: 12 pid: 5918 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918516.238695:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:1.0:1788918516.238702:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89208175-5136-4226-96dc-dc05cbfafbe9+12:2349:x1875816855123456:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918516.238710:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918516.238714:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc1493c00/0x2811b8b2b0ac8d44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ea expref: 12 pid: 5918 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238733:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc1493c00/0x2811b8b2b0ac8d44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ea expref: 12 pid: 5918 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238756:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238764:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238778:0:5909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238786:0:5909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238793:0:5909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238799:0:5909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238805:0:5909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691fc00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918516.238809:0:5909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238817:0:5909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238825:0:5909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918516.238847:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918516.238884:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89208175-5136-4226-96dc-dc05cbfafbe9+12:2349:x1875816855123456:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 182us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918516.238891:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:3.0:1788918516.240532:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865640832:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788918516.240615:0:11488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1493c00/0x2811b8b2b0ac8d44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f02ea expref: 11 pid: 5918 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918516.240628:0:11488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11488:1875816865640704:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918516.240834:0:11488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918516.240846:0:11488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918516.240853:0:11488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918516.240859:0:11488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8d9f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918516.253434:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788918517.270148:0:5921:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788918517.270157:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94ffef803800 from 7 10000000:01000000:2.0:1788918517.270171:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788918517.270219:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918517.270231:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918517.270242:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918517.270269:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865640960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788918517.270384:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918517.270579:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc894fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918517.279802:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865640960 00000100:00100000:0.0:1788918517.279818:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865640960 00000100:00100000:0.0:1788918517.279898:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788918517.279910:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:5921:x1875816865640960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788918517.279928:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918517.279951:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8dad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8da6 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918517.279980:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8da6 expref: 17 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918517.279991:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8da6 expref: 17 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918517.280000:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691fc00, rc 0) 00000100:00100000:0.0:1788918517.280104:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865640960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (9720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918517.280111:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00010000:00010000:1.0:1788918517.280315:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918517.281085:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865640960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918517.281108:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8dad expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918517.281120:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8dad expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918517.281198:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788918517.281241:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918517.281297:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc894fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918517.282845:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865641088 00000100:00100000:0.0:1788918517.282858:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865641088 00000100:00100000:0.0:1788918517.282994:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788918517.283004:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865641088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918517.283266:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865641088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918517.283487:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918517.283534:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788918517.283581:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788918517.283584:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918517.283618:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6b5be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788918517.283697:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865641216 00000100:00100000:0.0:1788918517.283702:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865641216 00000100:00100000:0.0:1788918517.283720:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788918517.283727:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865641216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788918517.283818:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865641216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918517.283826:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788918517.289167:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788918517.297605:0:11501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788918517.297699:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788918517.297727:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788918517.297739:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8dad expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.297751:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8dad expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918517.297762:0:5921:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788918517.297764:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94fffcaac000 from 7 10000000:01000000:3.0:1788918517.297767:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788918517.297804:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.297812:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.297830:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918517.297867:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788918517.297934:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918517.297974:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6b5b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788918517.298007:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865641344 00000100:00100000:3.0:1788918517.298014:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865641344 00000100:00100000:3.0:1788918517.298074:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788918517.298082:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865641344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918517.298095:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918517.298106:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffefbf4200/0x2811b8b2b0ac8dbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8db4 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.298128:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffefbf4200/0x2811b8b2b0ac8dbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8db4 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.298137:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffefbf4200/0x2811b8b2b0ac8dbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8db4 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.298146:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4200, rc 0) 00000100:00100000:3.0:1788918517.298178:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865641344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918517.298184:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788918517.298223:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918517.298235:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8dbb expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.298249:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8dbb expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918517.298299:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918517.298332:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918517.298350:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6b5b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788918517.298362:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865641472 00000100:00100000:3.0:1788918517.298364:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865641472 00000100:00100000:3.0:1788918517.298377:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788918517.298381:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865641472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918517.298464:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865641472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918517.298471:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788918517.298495:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918517.298516:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918517.298551:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918517.298562:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6b5b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788918517.298575:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865641600 00000100:00100000:3.0:1788918517.298577:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865641600 00000100:00100000:3.0:1788918517.298592:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788918517.298596:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865641600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918517.298664:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865641600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918517.298671:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788918517.298713:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788918517.299468:0:11503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788918517.299507:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788918517.299521:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788918517.299526:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8dbb expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.299534:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8dbb expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918517.299543:0:5921:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788918517.299545:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94fffbe70000 from 7 10000000:01000000:3.0:1788918517.299547:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788918517.299565:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.299571:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.299578:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918517.299590:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788918517.299620:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918517.299641:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe1fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788918517.299656:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865641728 00000100:00100000:3.0:1788918517.299659:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865641728 00000100:00100000:3.0:1788918517.299678:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788918517.299683:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865641728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918517.299699:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918517.299708:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffefbf5a00/0x2811b8b2b0ac8dc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8dc2 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.299722:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffefbf5a00/0x2811b8b2b0ac8dc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8dc2 expref: 19 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.299730:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffefbf5a00/0x2811b8b2b0ac8dc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8dc2 expref: 19 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.299737:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5a00, rc 0) 00000100:00100000:3.0:1788918517.299761:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865641728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918517.299767:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788918517.299796:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918517.299805:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8dc9 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.299813:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8dc9 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918517.299848:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918517.299870:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918517.299883:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe1fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788918517.299896:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865641856 00000100:00100000:3.0:1788918517.299898:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865641856 00000100:00100000:3.0:1788918517.299913:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788918517.299918:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865641856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918517.299989:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865641856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918517.299995:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788918517.300044:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918517.300067:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918517.300098:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918517.300118:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe1fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788918517.300130:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865641984 00000100:00100000:3.0:1788918517.300133:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865641984 00000100:00100000:3.0:1788918517.300149:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788918517.300154:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865641984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918517.300217:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865641984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918517.300224:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788918517.300261:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865641984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788918517.321800:0:11504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788918517.322768:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788918517.322798:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788918517.322810:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8dc9 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.322823:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8dc9 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918517.421872:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918517.422009:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855123584 00000100:00100000:3.0:1788918517.422050:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855123584 00000100:00100000:3.0:1788918517.422102:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 228 00000100:00100000:3.0:1788918517.422124:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+11:5435:x1875816855123584:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918517.422140:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918517.422168:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffefbf5c00/0x2811b8b2b0ac8dd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f034c expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.422197:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffefbf5c00/0x2811b8b2b0ac8dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f034c expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.422208:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffefbf5c00/0x2811b8b2b0ac8dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f034c expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918517.422217:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5c00, rc 0) 00000100:00100000:3.0:1788918517.422271:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+12:5435:x1875816855123584:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 149us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918517.422279:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 228 00000100:00100000:3.0:1788918517.427545:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918517.427739:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855123712 00000100:00100000:0.0:1788918517.427749:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855123712 00000100:00100000:0.0:1788918517.427802:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 229 00000100:00100000:0.0:1788918517.427812:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+12:5435:x1875816855123712:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918517.427952:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+12:5435:x1875816855123712:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 142us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918517.427961:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 229 00000100:00100000:0.0:1788918517.432674:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918517.432767:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855123840 00000100:00100000:2.0:1788918517.432777:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855123840 00000100:00100000:2.0:1788918517.432828:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 230 00000100:00100000:2.0:1788918517.432838:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+12:5435:x1875816855123840:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918517.432972:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+12:5435:x1875816855123840:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 135us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918517.432981:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 230 00000100:00100000:3.0:1788918517.453131:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918517.454111:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855123968 00000100:00100000:2.0:1788918517.454121:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855123968 00000100:00100000:2.0:1788918517.454183:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 231 00000100:00100000:2.0:1788918517.454193:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+12:5435:x1875816855123968:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918517.454208:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918517.454223:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac8dd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f0353 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918517.454269:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac8dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0353 expref: 13 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918517.454289:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac8dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0353 expref: 13 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918517.454299:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd800, rc 0) 00000100:00100000:2.0:1788918517.454361:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:5435:x1875816855123968:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 169us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918517.454368:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 231 00000100:00100000:3.0:1788918517.456592:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918517.456689:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855124096 00000100:00100000:0.0:1788918517.456698:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855124096 00000100:00100000:0.0:1788918517.456755:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 232 00000100:00100000:0.0:1788918517.456766:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:5435:x1875816855124096:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918517.456906:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:5435:x1875816855124096:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 141us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918517.456914:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 232 00000100:00100000:3.0:1788918517.460462:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918517.466244:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855124224 00000100:00100000:0.0:1788918517.466268:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855124224 00000100:00100000:0.0:1788918517.466355:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 233 00000100:00100000:0.0:1788918517.466366:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:5435:x1875816855124224:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788918517.466502:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:5435:x1875816855124224:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 137us (6047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918517.466510:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 233 00010000:00010000:1.0:1788918518.298408:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918518.367501:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865642112:0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.367570:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918518.367617:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865642624:0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.367644:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918518.367669:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788918518.367676:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865642496:0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.367700:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918518.367729:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865642240:0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.367752:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918518.367770:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865642752:0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.367795:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918518.367813:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788918518.367818:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865642368:0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.367839:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918518.367870:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865642112 00000100:00100000:0.0:1788918518.367877:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865642112 00000100:00100000:0.0:1788918518.367921:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788918518.367929:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865642112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.367977:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865642112:12345-0@lo:400:kworker.0 Request processed in 47us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918518.367992:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788918518.368043:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865642624 00000100:00100000:0.0:1788918518.368047:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865642624 00000100:00100000:0.0:1788918518.368079:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865642240 00000100:00100000:0.0:1788918518.368082:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865642240 00000100:00100000:0.0:1788918518.368095:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865642368 00000100:00100000:0.0:1788918518.368097:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865642368 00000100:00100000:0.0:1788918518.368110:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788918518.368115:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865642624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.368148:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865642624:12345-0@lo:400:kworker.0 Request processed in 32us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918518.368154:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788918518.368166:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788918518.368171:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865642240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.368201:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865642240:12345-0@lo:400:kworker.0 Request processed in 30us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918518.368208:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788918518.368219:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788918518.368224:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865642368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.368248:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865642368:12345-0@lo:400:kworker.0 Request processed in 24us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918518.368254:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788918518.368271:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865642496 00000100:00100000:0.0:1788918518.368275:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865642496 00000100:00100000:0.0:1788918518.368307:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865642752 00000100:00100000:0.0:1788918518.368322:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865642752 00000100:00100000:0.0:1788918518.368344:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788918518.368357:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865642496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.368387:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865642496:12345-0@lo:400:kworker.0 Request processed in 32us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918518.368393:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788918518.368404:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788918518.368409:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff4ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865642752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.368435:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff4ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865642752:12345-0@lo:400:kworker.0 Request processed in 27us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918518.368440:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788918518.368581:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788918518.368585:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788918518.368587:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918518.368616:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865642368:0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.368625:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865642240:0@lo:400:kworker.0 00010000:00080000:0.0:1788918518.368635:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefd46680 x1875816865642752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918518.368645:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865642752:0@lo:400:kworker.0 00010000:00080000:0.0:1788918518.368669:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefd46a00 x1875816865642496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918518.368678:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865642496:0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.368684:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865642112:0@lo:400:kworker.0 00000100:00100000:0.0:1788918518.368691:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865642624:0@lo:400:kworker.0 00000100:00100000:1.0:1788918518.368830:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865642880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918518.368858:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918518.368885:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865642880 00000100:00100000:1.0:1788918518.368888:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865642880 00000100:00100000:1.0:1788918518.368910:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788918518.368916:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865642880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918518.368936:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918518.368964:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865642880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918518.368970:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788918518.368992:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefcb0380 x1875816865642880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918518.369004:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865642880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918518.874478:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865643008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788918518.874556:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918518.875269:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865643008 00000100:00100000:2.0:1788918518.875289:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865643008 00000100:00100000:2.0:1788918518.875352:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788918518.875361:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865643008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918518.875390:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918518.875454:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865643008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918518.875462:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788918518.878195:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7fb800 x1875816865643008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918518.878223:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865643008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918518.955892:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918518.955985:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918518.957267:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855124480 00000100:00100000:2.0:1788918518.957288:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855124480 00000100:00100000:2.0:1788918518.957368:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 75 00000100:00100000:2.0:1788918518.957378:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855124480:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918518.957469:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855124480:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 92us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918518.957476:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 75 00000100:00080000:2.0:1788918518.957507:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918518.961128:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918518.961434:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855124608 00000100:00100000:3.0:1788918518.961456:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855124608 00000100:00100000:3.0:1788918518.961524:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 76 00000100:00100000:3.0:1788918518.961535:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855124608:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918518.961607:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855124608:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 74us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918518.961623:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 76 00000100:00080000:2.0:1788918518.962170:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918518.962701:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855124352 00000100:00100000:0.0:1788918518.962709:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855124352 00000100:00100000:0.0:1788918518.962761:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 235 00000100:00100000:0.0:1788918518.962770:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855124352:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918518.962829:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855124352:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 59us (6946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918518.962836:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 235 00010000:00010000:3.0:1788918519.336645:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918520.342920:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918521.368049:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788918521.963993:0:11686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788918522.395256:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918523.478774:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865643136:0@lo:400:kworker.0 00000100:00100000:0.0:1788918523.478847:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918523.478962:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865643648:0@lo:400:kworker.0 00000100:00100000:0.0:1788918523.478985:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918523.479007:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788918523.479012:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865643520:0@lo:400:kworker.0 00000100:00100000:0.0:1788918523.479056:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918523.479087:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865643520 00000100:00100000:0.0:1788918523.479095:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865643520 00000100:00100000:0.0:1788918523.479206:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788918523.479306:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865643520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918523.479411:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865643520:12345-0@lo:400:kworker.0 Request processed in 198us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918523.479417:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788918523.479586:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865643136 00000100:00100000:3.0:1788918523.479599:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865643136 00000100:00100000:3.0:1788918523.479624:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788918523.479630:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865643136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918523.479658:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865643136:12345-0@lo:400:kworker.0 Request processed in 29us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918523.479663:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00010000:00080000:0.0:1788918523.479773:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff77df80 x1875816865643520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918523.479786:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865643520:0@lo:400:kworker.0 00000100:00100000:0.0:1788918523.479797:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865643136:0@lo:400:kworker.0 00010000:00010000:1.0:1788918523.534816:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918523.534852:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865643264:0@lo:400:kworker.0 00000100:00100000:1.0:1788918523.534941:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918523.534995:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865643776:0@lo:400:kworker.0 00000100:00100000:1.0:1788918523.535059:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918523.535092:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788918523.535098:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865643392:0@lo:400:kworker.0 00000100:00100000:2.0:1788918523.536409:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865643648 00000100:00100000:2.0:1788918523.536420:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865643648 00000100:00100000:1.0:1788918523.536737:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918523.536787:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865643776 00000100:00100000:1.0:1788918523.536791:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865643776 00000100:00100000:1.0:1788918523.536822:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788918523.536831:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865643776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918523.536948:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865643264 00000100:00100000:2.0:1788918523.536951:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865643264 00000100:00100000:2.0:1788918523.536965:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865643392 00000100:00100000:2.0:1788918523.536966:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865643392 00000100:00100000:2.0:1788918523.536977:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788918523.536982:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865643648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918523.537036:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865643648:12345-0@lo:400:kworker.0 Request processed in 36us (58031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918523.537046:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788918523.537062:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788918523.537068:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865643264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918523.537170:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865643264:12345-0@lo:400:kworker.0 Request processed in 33us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918523.537177:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788918523.537188:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788918523.537194:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865643392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918523.537296:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865643392:12345-0@lo:400:kworker.0 Request processed in 102us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918523.537302:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788918523.537380:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788918523.537385:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788918523.537387:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918523.537654:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865643904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918523.537685:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918523.537719:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865643904 00000100:00100000:3.0:1788918523.537722:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865643904 00000100:00100000:3.0:1788918523.537745:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788918523.537751:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1875816865643904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788918523.537772:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918523.537799:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1875816865643904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918523.537804:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788918523.537826:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff77fb80 x1875816865643904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918523.537841:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865643904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918523.538759:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865643776:12345-0@lo:400:kworker.0 Request processed in 1924us (3694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918523.538772:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788918523.538925:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865643392:0@lo:400:kworker.0 00000100:00100000:2.0:1788918523.538960:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865643264:0@lo:400:kworker.0 00010000:00080000:2.0:1788918523.538970:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff77d880 x1875816865643776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918523.538979:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865643776:0@lo:400:kworker.0 00000100:00100000:0.0:1788918523.539171:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865643648:0@lo:400:kworker.0 00000100:00100000:2.0:1788918524.077162:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918524.077212:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918524.077238:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918524.077282:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855124992 00000100:00100000:2.0:1788918524.077292:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855124992 00000100:00100000:2.0:1788918524.077345:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855124864 00000100:00100000:2.0:1788918524.077348:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855124864 00000100:00100000:2.0:1788918524.077375:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:2.0:1788918524.077385:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2352:x1875816855124992:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918524.077459:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2352:x1875816855124992:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 75us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918524.077466:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:2.0:1788918524.077486:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00100000:2.0:1788918524.077492:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855124864:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918524.077517:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855124864:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 25us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918524.077523:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00080000:2.0:1788918524.077539:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918524.077670:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855124736 00000100:00100000:3.0:1788918524.077675:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855124736 00000100:00100000:3.0:1788918524.077724:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 237 00000100:00100000:3.0:1788918524.077732:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855124736:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918524.077760:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855124736:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 29us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918524.077766:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 237 00000100:00100000:2.0:1788918524.273156:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788918524.273179:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865644032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788918524.273246:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918524.273347:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865644032 00000100:00100000:2.0:1788918524.273354:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865644032 00000100:00100000:2.0:1788918524.273403:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788918524.273413:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865644032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918524.273443:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918524.274074:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865644032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 660us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918524.274083:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788918524.274142:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7f8e00 x1875816865644032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918524.274163:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865644032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788918524.438391:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918525.462354:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918526.487399:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918527.510342:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918528.535490:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918528.599322:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788918528.599368:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865644160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918528.599489:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918528.599773:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865644160 00000100:00100000:1.0:1788918528.599784:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865644160 00000100:00100000:1.0:1788918528.599862:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788918528.599872:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865644160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918528.599913:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918528.599968:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865644160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918528.599977:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788918528.600074:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff77fb80 x1875816865644160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918528.600098:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865644160:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788918528.600175:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788918528.613756:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865644288:0@lo:400:kworker.0 00000100:00100000:2.0:1788918528.613875:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918528.614178:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865644416:0@lo:400:kworker.0 00000100:00100000:1.0:1788918528.614232:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918528.614308:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865644416 00000100:00100000:1.0:1788918528.614318:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865644416 00000100:00100000:1.0:1788918528.614395:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788918528.614406:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865644416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918528.614483:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865644416:12345-0@lo:400:kworker.0 Request processed in 78us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918528.614492:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788918528.614560:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865644416:0@lo:400:kworker.0 00000100:00100000:0.0:1788918528.616072:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865644288 00000100:00100000:0.0:1788918528.616086:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865644288 00000100:00100000:0.0:1788918528.616158:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788918528.616169:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865644288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918528.616774:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788918528.616791:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865644800:0@lo:400:kworker.0 00000100:00100000:1.0:1788918528.616856:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918528.616907:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865644544:0@lo:400:kworker.0 00000100:00100000:1.0:1788918528.616935:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918528.616956:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788918528.616962:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865644672:0@lo:400:kworker.0 00000100:00100000:1.0:1788918528.616990:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918528.617038:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865644800 00000100:00100000:1.0:1788918528.617044:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865644800 00000100:00100000:1.0:1788918528.617086:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865644544 00000100:00100000:1.0:1788918528.617090:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865644544 00000100:00100000:1.0:1788918528.617113:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788918528.617120:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865644800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918528.617164:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865644800:12345-0@lo:400:kworker.0 Request processed in 44us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918528.617185:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788918528.617202:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788918528.617208:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865644544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918528.617250:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865644544:12345-0@lo:400:kworker.0 Request processed in 42us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918528.617257:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788918528.617276:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918528.617310:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865644800:0@lo:400:kworker.0 00000100:00100000:1.0:1788918528.617336:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865644544:0@lo:400:kworker.0 00000100:00100000:1.0:1788918528.617389:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865644672 00000100:00100000:1.0:1788918528.617393:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865644672 00000100:00100000:1.0:1788918528.617440:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788918528.617447:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865644672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918528.617485:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865644672:12345-0@lo:400:kworker.0 Request processed in 39us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918528.617491:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788918528.617783:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788918528.617803:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff77fb80 x1875816865644672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918528.617815:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865644672:0@lo:400:kworker.0 00000100:00100000:0.0:1788918528.618043:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865644288:12345-0@lo:400:kworker.0 Request processed in 1849us (4141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918528.618052:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788918528.618153:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865644288:0@lo:400:kworker.0 00000100:00100000:2.0:1788918529.197882:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918529.198063:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918529.198128:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918529.198231:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855125376 00000100:00100000:1.0:1788918529.198244:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855125376 00000100:00100000:1.0:1788918529.198339:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855125248 00000100:00100000:1.0:1788918529.198343:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855125248 00000100:00100000:1.0:1788918529.198374:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:1.0:1788918529.198397:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855125376:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918529.198513:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855125376:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 120us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918529.198522:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:1.0:1788918529.198543:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 86 00000100:00100000:1.0:1788918529.198550:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855125248:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918529.198577:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855125248:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918529.198582:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 86 00000100:00080000:2.0:1788918529.198762:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918529.198965:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855125120 00000100:00100000:0.0:1788918529.198971:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855125120 00000100:00100000:0.0:1788918529.199112:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 239 00000100:00100000:0.0:1788918529.199120:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855125120:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918529.199229:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855125120:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 110us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918529.199236:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 239 00010000:00010000:1.0:1788918529.558267:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918529.630310:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865644928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918529.630431:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918529.630838:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865644928 00000100:00100000:2.0:1788918529.630849:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865644928 00000100:00100000:2.0:1788918529.630923:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788918529.630935:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865644928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918529.630976:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918529.631176:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865644928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 241us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918529.631215:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788918529.631322:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefc35500 x1875816865644928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918529.631359:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865644928:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788918529.676596:0:11835:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:48:46 (1788918526) === 00000100:00100000:3.0:1788918529.986463:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918529.986570:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918529.987449:0:5933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855125632 00000100:00100000:2.0:1788918529.987463:0:5933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855125632 00000100:00100000:2.0:1788918529.987525:0:5933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:2.0:1788918529.987535:0:5933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9b921db9-4859-438b-976e-b950f67eace4+6:9600:x1875816855125632:12345-192.168.202.49@tcp:700:mkdir.0 00000100:00100000:2.0:1788918529.987648:0:5933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9b921db9-4859-438b-976e-b950f67eace4+6:9600:x1875816855125632:12345-192.168.202.49@tcp:700:mkdir.0 Request processed in 113us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918529.987656:0:5933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:1.0:1788918529.989452:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855125504 00000100:00100000:1.0:1788918529.989467:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855125504 00000100:00100000:1.0:1788918529.989535:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:1.0:1788918529.989544:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855125504:12345-192.168.202.49@tcp:41:mkdir.0 00000004:00000024:1.0:1788918529.989580:0:5926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1788918529.989667:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855125504:12345-192.168.202.49@tcp:41:mkdir.0 Request processed in 123us (3215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918529.989675:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:0.0:1788918530.014552:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918530.014595:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855125888 00000100:00100000:0.0:1788918530.014606:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855125888 00000100:00100000:0.0:1788918530.015259:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:0.0:1788918530.015270:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+6:9600:x1875816855125888:12345-192.168.202.49@tcp:36:mkdir.0 00010000:00010000:0.0:1788918530.015329:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918530.015367:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc000/0x2811b8b2b0ac8cbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02d5 expref: 6 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.016523:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ffff5d1900) 00010000:00010000:0.0:1788918530.016552:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918530.017531:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dde lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.017552:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dde lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.017566:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dde lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.017618:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8de5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.017627:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8de5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.017634:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8de5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918530.023961:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788918530.023983:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dde lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.023994:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dde lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.024002:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dde lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.024781:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691fe00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918530.024792:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dde lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.024803:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dde lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.024822:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681ca00) 00010000:00010000:0.0:1788918530.024826:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918530.024831:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dde lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.024837:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dde lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788918530.024858:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012e64e61 reply state 00000000cd9ac952 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8de5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918530.024868:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788918530.024983:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+7:9600:x1875816855125888:12345-192.168.202.49@tcp:36:mkdir.0 Request processed in 9710us (10439us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788918530.024993:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00010000:00010000:0.0:1788918530.041081:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8de5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.041102:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8de5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.041110:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8de5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.041134:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691fa00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918530.041139:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8de5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.041148:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8de5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.041165:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94fff681c600) 00010000:00010000:0.0:1788918530.041169:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918530.041174:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8de5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.041182:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8de5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918530.058539:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918530.058698:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855126016 00000100:00100000:3.0:1788918530.058709:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855126016 00000100:00100000:3.0:1788918530.059913:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:3.0:1788918530.059923:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:9601:x1875816855126016:12345-192.168.202.49@tcp:101:chmod.0 00010000:00010000:3.0:1788918530.059944:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918530.059969:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5000/0x2811b8b2b0ac8dec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f035a expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.060054:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac8df3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.060084:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac8df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.060097:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac8df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918530.060143:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788918530.060147:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918530.060186:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac8df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.060932:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5000/0x2811b8b2b0ac8dec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f035a expref: 8 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.060952:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac8df3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f035a expref: 7 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.060960:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e300) 00010000:00010000:3.0:1788918530.060963:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788918530.060966:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5600, rc 0) 00000100:00100000:3.0:1788918530.062143:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+7:9601:x1875816855126016:12345-192.168.202.49@tcp:101:chmod.0 Request processed in 2213us (3606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918530.062154:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:2.0:1788918530.282538:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918530.282684:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855126272 00000100:00100000:0.0:1788918530.282696:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855126272 00000100:00100000:0.0:1788918530.282819:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:0.0:1788918530.282831:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+7:9601:x1875816855126272:12345-192.168.202.49@tcp:36:chmod.0 00010000:00010000:0.0:1788918530.282903:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918530.282931:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac8df3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f035a expref: 7 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.282952:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e300) 00010000:00010000:0.0:1788918530.282963:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918530.282987:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dfa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.283067:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dfa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.283079:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dfa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788918530.283282:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a347afea reply state 00000000ea9d6610 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dfa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918530.283292:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788918530.283299:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788918530.283387:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+8:9601:x1875816855126272:12345-192.168.202.49@tcp:36:chmod.0 Request processed in 558us (859us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788918530.283394:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00010000:00010000:2.0:1788918530.289702:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dfa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.289721:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dfa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.289730:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dfa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.289736:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691fe00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918530.289740:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dfa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.289748:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dfa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.289764:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681c600) 00010000:00010000:2.0:1788918530.289767:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788918530.289789:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dfa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.289795:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8dfa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918530.365298:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918530.365427:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855126400 00000100:00100000:3.0:1788918530.365439:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855126400 00000100:00100000:3.0:1788918530.365548:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:3.0:1788918530.365560:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+7:9602:x1875816855126400:12345-192.168.202.49@tcp:101:chown.0 00010000:00010000:3.0:1788918530.365587:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918530.365625:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5000/0x2811b8b2b0ac8e01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0361 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.365694:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac8e08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.365709:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac8e08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.365721:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac8e08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918530.365768:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788918530.365772:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918530.365814:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac8e08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.365842:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5000/0x2811b8b2b0ac8e01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0361 expref: 9 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.365861:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac8e08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0361 expref: 8 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.365870:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e200) 00010000:00010000:3.0:1788918530.365873:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788918530.365877:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4800, rc 0) 00000100:00100000:3.0:1788918530.366084:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+8:9602:x1875816855126400:12345-192.168.202.49@tcp:101:chown.0 Request processed in 526us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918530.366093:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:0.0:1788918530.369877:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918530.370004:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855126528 00000100:00100000:1.0:1788918530.370014:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855126528 00000100:00100000:1.0:1788918530.370419:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:1.0:1788918530.370429:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+8:9602:x1875816855126528:12345-192.168.202.49@tcp:101:chown.0 00010000:00010000:1.0:1788918530.370449:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918530.370472:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0368 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370560:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370575:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370587:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370602:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370609:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370627:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370708:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac8e24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370716:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac8e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370723:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac8e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918530.370763:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788918530.370767:0:11359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788918530.370786:0:11359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac8e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370808:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370816:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370823:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370830:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918530.370834:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370842:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370853:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e200) 00010000:00010000:1.0:1788918530.370855:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918530.370860:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370866:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370880:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370886:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370892:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370903:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918530.370906:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370912:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370919:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94fff48fc900) 00010000:00010000:1.0:1788918530.370922:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918530.370924:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370929:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370959:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0368 expref: 10 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370972:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac8e24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0368 expref: 9 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.370979:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94fff48fcb00) 00010000:00010000:1.0:1788918530.370981:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788918530.370983:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4000, rc 0) 00000100:00100000:1.0:1788918530.371220:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+9:9602:x1875816855126528:12345-192.168.202.49@tcp:101:chown.0 Request processed in 792us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918530.371228:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:1.0:1788918530.375134:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918530.375246:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855126784 00000100:00100000:0.0:1788918530.375258:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855126784 00000100:00100000:0.0:1788918530.375323:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:0.0:1788918530.375333:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+9:9602:x1875816855126784:12345-192.168.202.49@tcp:36:chown.0 00010000:00010000:0.0:1788918530.375391:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918530.375417:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac8e24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0368 expref: 9 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.375435:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94fff48fcb00) 00010000:00010000:0.0:1788918530.375445:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918530.375468:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8e2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.375490:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8e2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.375501:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8e2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788918530.379212:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788918530.379376:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093109a85 reply state 00000000d28f6967 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8e2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918530.379390:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788918530.379402:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1788918530.379547:0:5925:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788918530.379570:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+7:9602:x1875816855126784:12345-192.168.202.49@tcp:36:chown.0 Request processed in 4235us (4442us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788918530.379579:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00010000:00010000:2.0:1788918530.379779:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8e2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.379790:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8e2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.379798:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8e2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.379804:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691f000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918530.379809:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8e2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.379817:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8e2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.379834:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94fff681ca00) 00010000:00010000:2.0:1788918530.379838:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788918530.379843:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8e2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.379849:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8e2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918530.403408:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918530.403566:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855126912 00000100:00100000:0.0:1788918530.403577:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855126912 00000100:00100000:0.0:1788918530.403823:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:0.0:1788918530.403836:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+6:9603:x1875816855126912:12345-192.168.202.49@tcp:101:touch.500 00010000:00010000:0.0:1788918530.403860:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918530.403882:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0ac8e32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f036f expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788918530.408820:0:5924:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4887us 00010000:00010000:1.0:1788918530.420862:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.420887:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.420900:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.420919:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.420927:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.420933:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421349:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421360:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421368:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918530.421398:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788918530.421402:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788918530.421445:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421475:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421482:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421488:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421494:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918530.421498:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421506:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421519:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e200) 00010000:00010000:1.0:1788918530.421522:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918530.421526:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421533:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421546:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421552:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421558:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421571:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918530.421574:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421580:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421589:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94fff68f4a00) 00010000:00010000:1.0:1788918530.421591:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918530.421594:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421600:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421714:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0ac8e32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f036f expref: 8 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421730:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f036f expref: 7 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.421737:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94fff68f4b00) 00010000:00010000:1.0:1788918530.421739:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788918530.421741:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4400, rc 0) 00000100:00100000:1.0:1788918530.421859:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+7:9603:x1875816855126912:12345-192.168.202.49@tcp:101:touch.500 Request processed in 18024us (18460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918530.421868:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:3.0:1788918530.424940:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918530.425258:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855127168 00000100:00100000:1.0:1788918530.425274:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855127168 00000100:00100000:1.0:1788918530.425332:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:1.0:1788918530.425341:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+7:9603:x1875816855127168:12345-192.168.202.49@tcp:101:touch.500 00010000:00010000:1.0:1788918530.425361:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918530.425378:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0376 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.425479:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.425493:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.425504:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.425550:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac8e5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.425557:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac8e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.425564:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac8e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788918530.426381:0:5926:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788918530.426525:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac8e63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.426536:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac8e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.426555:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac8e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.426588:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.426595:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.426601:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.426825:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918530.426829:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.426836:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.426848:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94fff68f4b00) 00010000:00010000:1.0:1788918530.426851:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918530.426856:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.426862:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac8e55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788918530.426875:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005168f066 reply state 0000000049bf096f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac8e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918530.426884:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788918530.426925:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0376 expref: 10 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.426939:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac8e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0376 expref: 9 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.426946:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94fff68f4300) 00010000:00010000:1.0:1788918530.426948:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788918530.426951:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4a00, rc 0) 00000100:00100000:1.0:1788918530.427255:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+10:9603:x1875816855127168:12345-192.168.202.49@tcp:101:touch.500 Request processed in 1912us (2322us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788918530.427264:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 22 00010000:00010000:3.0:1788918530.431479:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac8e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.431497:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac8e5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.431505:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac8e5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.431512:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918530.431516:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac8e5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.431524:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac8e5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.431540:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa8342a25 (ffff94fff68f4a00) 00010000:00010000:3.0:1788918530.431543:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918530.431547:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac8e5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.431553:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac8e5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918530.432736:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918530.432806:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855127424 00000100:00100000:1.0:1788918530.432816:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855127424 00000100:00100000:1.0:1788918530.432878:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:1.0:1788918530.432888:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+9:9603:x1875816855127424:12345-192.168.202.49@tcp:36:touch.500 00010000:00010000:1.0:1788918530.432944:0:11359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918530.432967:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac8e63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0376 expref: 9 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.432982:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94fff68f4300) 00010000:00010000:1.0:1788918530.432989:0:11359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788918530.433074:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac8e71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.433088:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac8e71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.433098:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac8e71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788918530.433242:0:11359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af15f5ad reply state 00000000554b3717 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac8e71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918530.433251:0:11359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788918530.433334:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+10:9603:x1875816855127424:12345-192.168.202.49@tcp:36:touch.500 Request processed in 448us (605us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788918530.433342:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 23 00010000:00010000:2.0:1788918530.435861:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac8e71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.435893:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac8e71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.435901:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac8e71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.435908:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918530.435914:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac8e71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.435922:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac8e71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.435938:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94fff68f4e00) 00010000:00010000:2.0:1788918530.435942:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918530.435948:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac8e71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.435954:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac8e71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918530.438621:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918530.438707:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855127552 00000100:00100000:0.0:1788918530.438718:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855127552 00000100:00100000:0.0:1788918530.438779:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:0.0:1788918530.438790:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+9:9603:x1875816855127552:12345-192.168.202.49@tcp:101:touch.500 00010000:00010000:0.0:1788918530.438830:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918530.438853:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0ac8e78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f037d expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.438909:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0ac8e78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f037d expref: 10 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.438925:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0ac8e78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f037d expref: 10 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.438945:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94fff681c300) 00010000:00010000:0.0:1788918530.438948:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788918530.438953:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691e600, rc 0) 00000100:00100000:0.0:1788918530.439059:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+10:9603:x1875816855127552:12345-192.168.202.49@tcp:101:touch.500 Request processed in 232us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918530.439067:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:0.0:1788918530.442722:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918530.442803:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855127680 00000100:00100000:1.0:1788918530.442816:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855127680 00000100:00100000:1.0:1788918530.442871:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:1.0:1788918530.442881:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875816855127680:12345-192.168.202.49@tcp:8:touch.500 00010000:00080000:1.0:1788918530.442916:0:6909:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1788918530.442973:0:6909:0:(genops.c:1385:class_connect()) connect: client 9b921db9-4859-438b-976e-b950f67eace4, cookie 0x2811b8b2b0ac8e7f 00002000:00100000:1.0:1788918530.442985:0:6909:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9b921db9-4859-438b-976e-b950f67eace4/ffff94ffefe1b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788918530.443003:0:6909:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788918530.443140:0:6909:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788918530.443174:0:6909:0:(import.c:65:import_set_state_nolock()) ffff94ffefe1b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788918530.443248:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2348:x1875816855127680:12345-192.168.202.49@tcp:8:touch.500 Request processed in 367us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918530.443256:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:2.0:1788918530.450501:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918530.450602:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855127808 00000100:00100000:1.0:1788918530.450622:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855127808 00000100:00100000:1.0:1788918530.450707:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:1.0:1788918530.450719:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+6:0:x1875816855127808:12345-192.168.202.49@tcp:2:touch.500 00000100:00080000:2.0:1788918530.450968:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788918530.467555:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1788918530.467569:0:7980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00000100:00100000:1.0:1788918530.467932:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:0:x1875816855127808:12345-192.168.202.49@tcp:2:touch.500 Request processed in 17209us (17433us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788918530.467953:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:3.0:1788918530.471224:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918530.471360:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855128064 00000100:00100000:1.0:1788918530.471370:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855128064 00000100:00100000:1.0:1788918530.471468:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:1.0:1788918530.471480:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+10:9603:x1875816855128064:12345-192.168.202.49@tcp:35:touch.500 00000100:00100000:1.0:1788918530.471893:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+11:9603:x1875816855128064:12345-192.168.202.49@tcp:35:touch.500 Request processed in 413us (692us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788918530.471901:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:0.0:1788918530.484512:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918530.484625:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855128192 00000100:00100000:1.0:1788918530.484636:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855128192 00000100:00100000:1.0:1788918530.484949:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:1.0:1788918530.484961:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+11:9604:x1875816855128192:12345-192.168.202.49@tcp:101:rm.0 00010000:00010000:1.0:1788918530.484988:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918530.485010:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac8e86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0384 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.485169:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.485183:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.485196:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918530.485303:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788918530.485306:0:11359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788918530.485364:0:11359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.485393:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac8e86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0384 expref: 13 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.485411:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0384 expref: 12 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.485420:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94fff68f4b00) 00010000:00010000:1.0:1788918530.485423:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788918530.485427:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5200, rc 0) 00000100:00100000:1.0:1788918530.485543:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+12:9604:x1875816855128192:12345-192.168.202.49@tcp:101:rm.0 Request processed in 584us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918530.485551:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:2.0:1788918530.489518:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918530.489913:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855128448 00000100:00100000:0.0:1788918530.489924:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855128448 00000100:00100000:0.0:1788918530.490062:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:0.0:1788918530.490076:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+12:9604:x1875816855128448:12345-192.168.202.49@tcp:101:rm.0 00010000:00010000:0.0:1788918530.490098:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918530.490119:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8e94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f038b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918530.490245:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788918530.490379:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8e94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f038b expref: 14 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.490393:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e200) 00010000:00010000:0.0:1788918530.490396:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788918530.490401:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8e94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f038b expref: 14 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.490415:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691f400, rc 0) 00000100:00100000:0.0:1788918530.490488:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+13:9604:x1875816855128448:12345-192.168.202.49@tcp:101:rm.0 Request processed in 415us (980us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788918530.490495:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:3.0:1788918530.493968:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918530.494239:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855128576 00000100:00100000:2.0:1788918530.494249:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855128576 00000100:00100000:2.0:1788918530.494309:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:2.0:1788918530.494319:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+13:9604:x1875816855128576:12345-192.168.202.49@tcp:37:rm.0 00000100:00100000:2.0:1788918530.497981:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+13:9604:x1875816855128576:12345-192.168.202.49@tcp:37:rm.0 Request processed in 3652us (4011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918530.498005:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:3.0:1788918530.501315:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918530.501396:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855128832 00000100:00100000:1.0:1788918530.501407:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855128832 00000100:00100000:1.0:1788918530.501465:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:1.0:1788918530.501475:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc719b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+13:9604:x1875816855128832:12345-192.168.202.49@tcp:35:rm.0 00000100:00100000:1.0:1788918530.501742:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc719b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+14:9604:x1875816855128832:12345-192.168.202.49@tcp:35:rm.0 Request processed in 268us (437us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788918530.501751:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:2.0:1788918530.505784:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918530.505889:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855129088 00000100:00100000:0.0:1788918530.505899:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855129088 00000100:00100000:0.0:1788918530.505996:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:0.0:1788918530.506006:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+14:9604:x1875816855129088:12345-192.168.202.49@tcp:101:rm.0 00010000:00010000:0.0:1788918530.506064:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918530.506089:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8ea2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0392 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.506192:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e000/0x2811b8b2b0ac8ea9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.506219:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e000/0x2811b8b2b0ac8ea9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.506250:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e000/0x2811b8b2b0ac8ea9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918530.506262:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788918530.506360:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8ea2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0392 expref: 17 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.506380:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e000/0x2811b8b2b0ac8ea9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0392 expref: 16 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.506388:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94fff68f4b00) 00010000:00010000:0.0:1788918530.506391:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788918530.506394:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691e000, rc 0) 00000100:00100000:0.0:1788918530.506540:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+16:9604:x1875816855129088:12345-192.168.202.49@tcp:101:rm.0 Request processed in 534us (766us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788918530.506548:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:3.0:1788918530.509998:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918530.510417:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855129216 00000100:00100000:1.0:1788918530.510427:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855129216 00000100:00100000:1.0:1788918530.510525:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:1.0:1788918530.510536:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+16:9604:x1875816855129216:12345-192.168.202.49@tcp:41:rm.0 00000004:00000024:1.0:1788918530.510591:0:5926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847337984 avail 7384293376 00000100:00100000:1.0:1788918530.510700:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+16:9604:x1875816855129216:12345-192.168.202.49@tcp:41:rm.0 Request processed in 165us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918530.510707:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:3.0:1788918530.513740:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918530.513964:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855129344 00000100:00100000:1.0:1788918530.513975:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855129344 00000100:00100000:0.0:1788918530.514137:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:0.0:1788918530.514151:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+16:9604:x1875816855129344:12345-192.168.202.49@tcp:101:rm.0 00010000:00010000:0.0:1788918530.514173:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918530.514195:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0ac8eb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0399 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514277:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8ebe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514293:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8ebe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514318:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8ebe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514335:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8ec5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514343:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514351:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514430:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8ecc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514439:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514447:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918530.514486:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788918530.514491:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788918530.514510:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514523:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514532:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8ebe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514547:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8ebe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514553:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8ebe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514559:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691f000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918530.514564:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8ebe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514570:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8ebe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514581:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94fff68f4b00) 00010000:00010000:0.0:1788918530.514584:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918530.514589:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8ebe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514596:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0ac8ebe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514610:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514616:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514621:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514626:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691fe00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918530.514634:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514640:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514649:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa8342a25 (ffff94fff681cc00) 00010000:00010000:0.0:1788918530.514651:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918530.514654:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8ec5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514675:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0ac8ec5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514709:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0ac8eb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0399 expref: 18 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514722:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8ecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0399 expref: 17 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.514729:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94fff681c300) 00010000:00010000:0.0:1788918530.514731:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788918530.514734:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691fa00, rc 0) 00000100:00100000:0.0:1788918530.514805:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+17:9604:x1875816855129344:12345-192.168.202.49@tcp:101:rm.0 Request processed in 657us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918530.514812:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:2.0:1788918530.518914:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918530.519162:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855129600 00000100:00100000:0.0:1788918530.519172:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855129600 00000100:00100000:0.0:1788918530.519238:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:0.0:1788918530.519249:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+17:9604:x1875816855129600:12345-192.168.202.49@tcp:36:rm.0 00010000:00010000:0.0:1788918530.519319:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788918530.519345:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fa00/0x2811b8b2b0ac8ecc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0399 expref: 17 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519368:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0ac8e78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f037d expref: 16 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519380:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94fff681c300) 00010000:00010000:0.0:1788918530.519395:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac8e8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0384 expref: 15 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519404:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94fff68f4b00) 00010000:00010000:0.0:1788918530.519407:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918530.519426:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8ed3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519439:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8ed3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519449:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8ed3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519464:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0ac8eda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519472:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0ac8eda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519479:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0ac8eda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519589:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac8ee1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519598:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac8ee1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519605:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac8ee1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788918530.519893:0:5925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788918530.519904:0:5925:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 232800882981ns, next at 233800880214ns, rc = 0 00010000:00010000:0.0:1788918530.519949:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8ee8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519958:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519966:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519973:0:5925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8ee8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519979:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8ee8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.519985:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8ee8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520325:0:5925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788918530.520347:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac8ee1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520362:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac8ee1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520369:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac8ee1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520374:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918530.520379:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac8ee1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520386:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac8ee1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520396:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94fff681c500) 00010000:00010000:0.0:1788918530.520398:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788918530.520402:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac8ee1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520407:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac8ee1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520422:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8ed3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520428:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8ed3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520433:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8ed3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520437:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691f400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918530.520445:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8ed3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520452:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8ed3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520460:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94fff68f4b00) 00010000:00010000:0.0:1788918530.520463:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918530.520466:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8ed3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.520472:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0ac8ed3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788918530.520482:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091b0bd4d reply state 00000000e5bcdfe4 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0ac8eda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918530.520489:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788918530.520584:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+16:9604:x1875816855129600:12345-192.168.202.49@tcp:36:rm.0 Request processed in 1335us (1678us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788918530.520592:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 30 00010000:00010000:3.0:1788918530.526138:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918530.526153:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8ee8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.526165:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918530.526169:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8ee8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.526180:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8ee8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.526211:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94fff681c500) 00010000:00010000:3.0:1788918530.526214:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788918530.526219:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8ee8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.526226:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8ee8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918530.526410:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918530.526413:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918530.526415:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918530.527627:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918530.527696:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855129856 00000100:00100000:1.0:1788918530.527708:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855129856 00000100:00100000:1.0:1788918530.527771:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:1.0:1788918530.527781:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+16:9604:x1875816855129856:12345-192.168.202.49@tcp:35:rm.0 00000100:00100000:1.0:1788918530.528054:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+17:9604:x1875816855129856:12345-192.168.202.49@tcp:35:rm.0 Request processed in 238us (398us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788918530.528063:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00010000:00010000:3.0:1788918530.529398:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0ac8eda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.529414:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0ac8eda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.529422:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0ac8eda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.529429:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691f600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918530.529434:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0ac8eda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.529443:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0ac8eda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.529473:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa8342a25 (ffff94fff681c400) 00010000:00010000:3.0:1788918530.529477:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918530.529482:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0ac8eda lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.529489:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0ac8eda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa8342a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918530.531465:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918530.531605:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855130112 00000100:00100000:0.0:1788918530.531615:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855130112 00000100:00100000:0.0:1788918530.531784:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:0.0:1788918530.531796:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+16:9604:x1875816855130112:12345-192.168.202.49@tcp:36:rm.0 00010000:00010000:0.0:1788918530.531851:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788918530.531875:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e000/0x2811b8b2b0ac8ea9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0392 expref: 16 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.531918:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac8e47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f036f expref: 15 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.531929:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94fff68f4b00) 00010000:00010000:0.0:1788918530.531942:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac8e08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0361 expref: 14 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.531951:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e200) 00010000:00010000:0.0:1788918530.531957:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918530.531980:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac8eef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.531991:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac8eef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532000:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac8eef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532011:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8ef6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532067:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532076:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532156:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac8efd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532174:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac8efd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532182:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac8efd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918530.532411:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788918530.532426:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac8efd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532434:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac8efd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532441:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac8efd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532447:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918530.532452:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac8efd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532459:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac8efd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532467:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94fff681c800) 00010000:00010000:0.0:1788918530.532470:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788918530.532473:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac8efd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532479:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac8efd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532497:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac8eef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532510:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac8eef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532516:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac8eef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532521:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918530.532524:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac8eef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532530:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac8eef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532537:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681cc00) 00010000:00010000:0.0:1788918530.532539:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918530.532542:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac8eef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918530.532549:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac8eef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788918530.532561:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032d22c9a reply state 00000000284984bd transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918530.532570:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788918530.532633:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+15:9604:x1875816855130112:12345-192.168.202.49@tcp:36:rm.0 Request processed in 840us (1176us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788918530.532641:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 31 00010000:00010000:3.0:1788918530.534956:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.534975:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8ef6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.534984:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8ef6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.534990:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918530.534995:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8ef6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.535003:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8ef6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.535058:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94fff681c000) 00010000:00010000:3.0:1788918530.535062:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918530.535066:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8ef6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918530.535074:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8ef6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918530.582377:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918531.612149:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918532.630687:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918533.655182:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788918533.718859:0:8366:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 235999835833ns, next at 236999833108ns, rc = 0 00000100:00100000:2.0:1788918533.719163:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865645056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918533.719241:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918533.719354:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865645056 00000100:00100000:1.0:1788918533.719361:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865645056 00000100:00100000:1.0:1788918533.719440:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788918533.719450:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865645056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918533.719479:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918533.719537:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865645056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918533.719544:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788918533.719585:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefcb1880 x1875816865645056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918533.719602:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865645056:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788918533.719867:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788918533.726434:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865645184:0@lo:400:kworker.0 00000100:00100000:1.0:1788918533.726519:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918533.726615:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865645184 00000100:00100000:2.0:1788918533.726624:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865645184 00000100:00100000:2.0:1788918533.726672:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788918533.726682:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865645184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918533.730312:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865645312:0@lo:400:kworker.0 00000100:00100000:0.0:1788918533.730381:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918533.730418:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865645824:0@lo:400:kworker.0 00000100:00100000:0.0:1788918533.730444:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918533.730467:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788918533.730474:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865645440:0@lo:400:kworker.0 00000100:00100000:0.0:1788918533.731604:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918533.731662:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865645312 00000100:00100000:0.0:1788918533.731671:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865645312 00000100:00100000:0.0:1788918533.731717:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865645440 00000100:00100000:0.0:1788918533.731720:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865645440 00000100:00100000:0.0:1788918533.731748:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788918533.731757:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865645312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918533.731816:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865645312:12345-0@lo:400:kworker.0 Request processed in 60us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918533.731822:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788918533.731839:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788918533.731845:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865645440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918533.731869:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865645440:12345-0@lo:400:kworker.0 Request processed in 25us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918533.731875:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788918533.731893:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865645824 00000100:00100000:0.0:1788918533.731897:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865645824 00000100:00100000:0.0:1788918533.731921:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788918533.731928:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865645824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918533.731956:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865645824:12345-0@lo:400:kworker.0 Request processed in 29us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918533.731972:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788918533.732034:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865645440:0@lo:400:kworker.0 00000100:00100000:0.0:1788918533.732048:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865645312:0@lo:400:kworker.0 00010000:00080000:0.0:1788918533.732065:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d81880 x1875816865645824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918533.732075:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865645824:0@lo:400:kworker.0 00000100:00080000:0.0:1788918533.732104:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918533.732118:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865645568:0@lo:400:kworker.0 00000100:00100000:0.0:1788918533.732162:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918533.732194:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788918533.732202:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865645696:0@lo:400:kworker.0 00000100:00100000:0.0:1788918533.732223:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918533.732246:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865645568 00000100:00100000:0.0:1788918533.732250:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865645568 00000100:00100000:0.0:1788918533.732278:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788918533.732284:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865645568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918533.732313:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865645568:12345-0@lo:400:kworker.0 Request processed in 30us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918533.732318:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788918533.732334:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865645696 00000100:00100000:0.0:1788918533.732337:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865645696 00000100:00100000:0.0:1788918533.732354:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788918533.732359:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865645696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918533.732382:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865645696:12345-0@lo:400:kworker.0 Request processed in 23us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918533.732393:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788918533.732408:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788918533.732411:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788918533.732427:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865645696:0@lo:400:kworker.0 00010000:00080000:0.0:1788918533.732438:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d80000 x1875816865645568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918533.732447:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865645568:0@lo:400:kworker.0 00000100:00100000:2.0:1788918533.734699:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3418:x1875816865645184:12345-0@lo:400:kworker.0 Request processed in 7998us (8159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918533.734713:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788918533.735892:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865645184:0@lo:400:kworker.0 00000100:00100000:2.0:1788918534.319889:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918534.319986:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918534.320090:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918534.320117:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918534.320148:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855130368 00000100:00100000:2.0:1788918534.320159:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855130368 00000100:00100000:2.0:1788918534.320229:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855130624 00000100:00100000:2.0:1788918534.320233:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855130624 00000100:00100000:2.0:1788918534.320259:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 90 00000100:00100000:2.0:1788918534.320268:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+14:2349:x1875816855130368:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918534.320544:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855130496 00000100:00100000:1.0:1788918534.320549:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855130496 00000100:00100000:1.0:1788918534.320583:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:1.0:1788918534.320590:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2349:x1875816855130496:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918534.320628:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2349:x1875816855130496:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 38us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918534.320635:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:1.0:1788918534.320682:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 91 00000100:00100000:1.0:1788918534.320690:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855130624:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918534.320717:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855130624:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 28us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918534.320723:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 91 00000100:00080000:1.0:1788918534.320741:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788918534.320745:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918534.321806:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+14:2349:x1875816855130368:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 1532us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918534.321816:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 90 00000100:00100000:0.0:1788918534.327286:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855130240 00000100:00100000:0.0:1788918534.327302:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855130240 00000100:00100000:0.0:1788918534.327382:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 241 00000100:00100000:0.0:1788918534.327392:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855130240:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918534.327481:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855130240:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 89us (7600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918534.327640:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 241 00010000:00010000:1.0:1788918534.678804:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918534.742334:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865645952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788918534.742408:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918534.742608:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865645952 00000100:00100000:1.0:1788918534.742617:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865645952 00000100:00100000:1.0:1788918534.742677:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788918534.742687:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865645952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788918534.742716:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918534.742874:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865645952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918534.742898:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788918534.742961:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefc36a00 x1875816865645952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918534.742980:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865645952:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788918535.708647:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788918536.036336:0:11983:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788918536.726300:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788918536.798932:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788918536.798965:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788918536.798976:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788918536.800776:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865646080:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788918536.800844:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918536.800916:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865646080 00000100:00100000:0.0:1788918536.800923:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865646080 00000100:00100000:0.0:1788918536.800996:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788918536.801011:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865646080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788918536.801055:0:7258:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788918536.801089:0:7258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa0bb01, atime: 0x6aa0bb01, ctime: 0x6aa0bb01, blocks: 0x0 00010000:00010000:0.0:1788918536.801097:0:7258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000011476f7/0x2811b8b2b0ac8f04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.801124:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=239s v=(0 0) 00010000:00010000:0.0:1788918536.801128:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918536.801135:0:7258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000011476f7/0x2811b8b2b0ac8f04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.801163:0:7258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000011476f7/0x2811b8b2b0ac8f04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.801173:0:7258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000011476f7/0x2811b8b2b0ac8f04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.801182:0:7258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000011476f7/0x2811b8b2b0ac8f04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.801201:0:7258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788918536.801349:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3417:x1875816865646080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 338us (503us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788918536.801356:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788918536.801378:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788918536.801389:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918536.801395:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000011476f7/0x2811b8b2b0ac8f04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.801409:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20600 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918536.801413:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000011476f7/0x2811b8b2b0ac8f04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.801423:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000011476f7/0x2811b8b2b0ac8f04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.801439:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000011476f7/0x2811b8b2b0ac8f04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.801447:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000011476f7/0x2811b8b2b0ac8f04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.801466:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918536.801468:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918536.801469:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788918536.801501:0:3417:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94ffe8d80a80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788918536.801507:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865646080:0@lo:6:osp-syn-1-0.0 00000020:00000080:1.0:1788918536.946724:0:12031:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5be38320 20000000:00000080:1.0:1788918536.946738:0:12031:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94fff69a1c00 uarg=0000000000000000 20000000:01000000:1.0:1788918536.946773:0:12031:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788918536.946777:0:12031:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788918536.946781:0:12031:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788918536.947736:0:12032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788918536.947921:0:12031:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788918536.953558:0:12031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788918536.953598:0:12031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788918536.953617:0:12031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788918536.953634:0:12031:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788918536.953655:0:12031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.953675:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8da6 expref: 18 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.953699:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffefbf4200/0x2811b8b2b0ac8dbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8db4 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.953706:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffefbf5a00/0x2811b8b2b0ac8dc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8dc2 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.953717:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffefbf5c00/0x2811b8b2b0ac8dd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f034c expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.953723:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac8dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0353 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.953731:0:12031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.953776:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac8dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0353 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.953791:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac8dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0353 expref: 12 pid: 5917 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918536.953807:0:12031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1875816865646208:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918536.957915:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffefbf5c00/0x2811b8b2b0ac8dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f034c expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.957935:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94ffefbf5c00/0x2811b8b2b0ac8dd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f034c expref: 12 pid: 5917 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918536.957951:0:12031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1875816865646336:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918536.958578:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffefbf5a00/0x2811b8b2b0ac8dc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8dc2 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.958589:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffefbf5a00/0x2811b8b2b0ac8dc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8dc2 expref: 18 pid: 5917 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918536.958601:0:12031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1875816865646464:0@lo:104: 00000100:00100000:0.0:1788918536.958641:0:12031:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788918536.958742:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffefbf4200/0x2811b8b2b0ac8dbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8db4 expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.958751:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94ffefbf4200/0x2811b8b2b0ac8dbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8db4 expref: 18 pid: 5917 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918536.958760:0:12031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc874700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1875816865646592:0@lo:104: 00000100:00100000:0.0:1788918536.958783:0:12031:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788918536.960548:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac8da6 expref: 18 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918536.960564:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8dad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8da6 expref: 18 pid: 5918 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918536.960575:0:12031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1875816865646720:0@lo:104: 00000100:00100000:0.0:1788918536.960623:0:12031:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918536.960643:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865646464 00000100:00100000:1.0:1788918536.960650:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865646464 00000100:00100000:3.0:1788918536.960942:0:5908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865646592 00000100:00100000:3.0:1788918536.960947:0:5908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865646592 00000100:00100000:3.0:1788918536.960989:0:5908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788918536.960999:0:5908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+4:12031:x1875816865646464:12345-0@lo:104: 00010000:00010000:3.0:1788918536.961015:0:5908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8dc9 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.961101:0:5908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788918536.961118:0:5908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+4:12031:x1875816865646464:12345-0@lo:104: Request processed in 121us (2477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918536.961126:0:5908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788918536.961154:0:5908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788918536.961160:0:5908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+3:12031:x1875816865646592:12345-0@lo:104: 00010000:00010000:3.0:1788918536.961168:0:5908:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8dbb expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.961208:0:5908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788918536.961213:0:5908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74aa73a2-313d-4992-b461-72ab8c3ab246+3:12031:x1875816865646592:12345-0@lo:104: Request processed in 54us (2431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918536.961219:0:5908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788918536.961237:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788918536.961243:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8dc9 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.961265:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4a00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918536.961269:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8dc9 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.961278:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8dc9 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918536.961285:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8dc9 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918536.961291:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788918536.961324:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8dc9 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.961331:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918536.961351:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8dc9 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.961359:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4a00/0x2811b8b2b0ac8dc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8dc9 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.961374:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918536.961377:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8dbb expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.961383:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5e00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918536.961386:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8dbb expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.961404:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8dbb expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918536.961411:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8dbb expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918536.961416:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788918536.961430:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8dbb expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.961435:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788918536.961450:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8dbb expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.961457:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5e00/0x2811b8b2b0ac8db4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8dbb expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.961467:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918536.961469:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918536.961470:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918536.961503:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865646848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788918536.961539:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918536.961573:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788918536.961581:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865646976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788918536.961603:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788918536.962078:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918536.962096:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865646848 00000100:00100000:2.0:1788918536.962112:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865646848 00010000:00010000:2.0:1788918536.962152:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffefbf5a00/0x2811b8b2b0ac8dc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8dc2 expref: 19 pid: 5917 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918536.962180:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865646976 00000100:00100000:2.0:1788918536.962183:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865646976 00010000:00010000:2.0:1788918536.962197:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffefbf4200/0x2811b8b2b0ac8dbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8db4 expref: 20 pid: 5917 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918536.962217:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788918536.962225:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+20:3418:x1875816865646848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788918536.962236:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918536.962242:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffefbf5a00/0x2811b8b2b0ac8dc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8dc2 expref: 20 pid: 5917 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918536.962252:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffefbf5a00/0x2811b8b2b0ac8dc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8dc2 expref: 20 pid: 5917 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918536.962271:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918536.962310:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+20:3418:x1875816865646848:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918536.962329:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788918536.962345:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788918536.962352:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865646976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788918536.962359:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918536.962364:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffefbf4200/0x2811b8b2b0ac8dbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8db4 expref: 19 pid: 5917 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918536.962372:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffefbf4200/0x2811b8b2b0ac8dbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8db4 expref: 19 pid: 5917 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918536.962382:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918536.962410:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865646976:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918536.962416:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788918536.962454:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865646976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788918536.962480:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865646848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788918536.962839:0:12031:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd81a3480 going to sleep for 11 seconds 00010000:00010000:0.0:1788918536.962856:0:12031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffefbf5a00/0x2811b8b2b0ac8dc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8dc2 expref: 18 pid: 5917 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918536.962868:0:12031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1875816865646464:0@lo:104: 00010000:00010000:0.0:1788918536.962878:0:12031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffefbf4200/0x2811b8b2b0ac8dbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8db4 expref: 17 pid: 5917 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918536.962895:0:12031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc874700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1875816865646592:0@lo:104: 00000100:00100000:1.0:1788918536.962969:0:5907:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788918536.962994:0:5907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865646720 00000100:00100000:1.0:1788918536.962998:0:5907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865646720 00000100:00100000:1.0:1788918536.963048:0:5907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788918536.963056:0:5907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefbe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:12031:x1875816865646720:12345-0@lo:104: 00010000:00010000:1.0:1788918536.963067:0:5907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8dad expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918536.963128:0:5907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788918536.963134:0:5907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefbe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+3:12031:x1875816865646720:12345-0@lo:104: Request processed in 79us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918536.963149:0:5907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788918536.963312:0:12031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1875816865646720:0@lo:104: 00010000:00010000:2.0:1788918536.963465:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918536.963471:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac8dad expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918536.963479:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dda00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:2.0:1788918536.963483:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac8dad expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918536.963491:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac8dad expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788918536.963510:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac8dad expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918536.963516:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788918536.963554:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8dad expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918536.963560:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788918536.963587:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8dad expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918536.963594:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac8da6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac8dad expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918536.963608:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918536.963610:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918536.963612:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918536.963619:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788918536.963630:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865647104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788918536.963667:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918536.963700:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865647104 00000100:00100000:2.0:1788918536.963704:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865647104 00010000:00010000:2.0:1788918536.963721:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8dad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8da6 expref: 17 pid: 5918 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918536.963742:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788918536.963749:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5097050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:3419:x1875816865647104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788918536.963758:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918536.963769:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8dad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8da6 expref: 17 pid: 5918 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918536.963778:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac8da6 expref: 17 pid: 5918 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918536.963789:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff691fc00/0x2811b8b2b0ac8dad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac8da6 expref: 17 pid: 5918 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918536.963799:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918536.963827:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5097050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3419:x1875816865647104:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918536.963834:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788918536.963881:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865647104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788918536.985126:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918536.985185:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918536.985422:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855130752 00000100:00100000:3.0:1788918536.985504:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855130752 00010000:00010000:3.0:1788918536.985617:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac8dd7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0353 expref: 13 pid: 5917 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918536.985821:0:12031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1875816865646208:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918536.985834:0:12031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12031:1875816865646336:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918536.985869:0:12031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918536.985991:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855130880 00000100:00100000:3.0:1788918536.985997:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855130880 00010000:00010000:3.0:1788918536.986016:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffefbf5c00/0x2811b8b2b0ac8dd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f034c expref: 14 pid: 5917 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918536.987891:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:3.0:1788918536.987910:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89208175-5136-4226-96dc-dc05cbfafbe9+14:2349:x1875816855130752:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918536.987928:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918536.987936:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac8dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0353 expref: 14 pid: 5917 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.987950:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac8dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0353 expref: 14 pid: 5917 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.987967:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac8dd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0353 expref: 14 pid: 5917 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.987995:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918536.988087:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855130752:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 183us (2980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918536.988095:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:3.0:1788918536.988127:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:3.0:1788918536.988135:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89208175-5136-4226-96dc-dc05cbfafbe9+12:2350:x1875816855130880:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918536.988151:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918536.988156:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffefbf5c00/0x2811b8b2b0ac8dd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f034c expref: 12 pid: 5917 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.988184:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffefbf5c00/0x2811b8b2b0ac8dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f034c expref: 12 pid: 5917 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.988195:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffefbf5c00/0x2811b8b2b0ac8dd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f034c expref: 12 pid: 5917 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.988206:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.988214:0:5910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.988242:0:5910:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.988252:0:5910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.988259:0:5910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.988265:0:5910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.988272:0:5910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20600 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918536.988276:0:5910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.988287:0:5910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.988313:0:5910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918536.988325:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918536.988347:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89208175-5136-4226-96dc-dc05cbfafbe9+11:2350:x1875816855130880:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 214us (3163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918536.988356:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 34 00010000:00010000:1.0:1788918536.999283:0:12031:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918536.999304:0:12031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918536.999312:0:12031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fffcb20600/0x2811b8b2b0ac8f0b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918537.752634:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918538.353101:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918538.353615:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855131008 00000100:00100000:2.0:1788918538.353625:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855131008 00000100:00100000:2.0:1788918538.353690:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 242 00000100:00100000:2.0:1788918538.353701:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+11:5435:x1875816855131008:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918538.353718:0:5917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918538.353738:0:5917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8f12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f03a0 expref: -99 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918538.353767:0:5917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8f12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03a0 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918538.353778:0:5917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8f12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03a0 expref: 12 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918538.353801:0:5917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dda00, rc 0) 00000100:00100000:2.0:1788918538.353865:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+12:5435:x1875816855131008:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 166us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918538.353872:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 242 00000100:00100000:3.0:1788918538.363607:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918538.363712:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855131136 00000100:00100000:0.0:1788918538.363722:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855131136 00000100:00100000:0.0:1788918538.363788:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 243 00000100:00100000:0.0:1788918538.363797:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+12:5435:x1875816855131136:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918538.363948:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+12:5435:x1875816855131136:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 151us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918538.363956:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 243 00000100:00100000:3.0:1788918538.375827:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918538.376236:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855131264 00000100:00100000:1.0:1788918538.376246:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855131264 00000100:00100000:1.0:1788918538.376305:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 244 00000100:00100000:1.0:1788918538.376316:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+12:5435:x1875816855131264:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788918538.376462:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+12:5435:x1875816855131264:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 147us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918538.376470:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 244 00000100:00100000:3.0:1788918538.384698:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918538.384803:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855131392 00000100:00100000:2.0:1788918538.384812:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855131392 00000100:00100000:2.0:1788918538.384868:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 245 00000100:00100000:2.0:1788918538.384878:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+12:9874:x1875816855131392:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788918538.385088:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+12:9874:x1875816855131392:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 211us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918538.385096:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 245 00000100:00100000:3.0:1788918538.396371:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918538.396480:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855131520 00000100:00100000:0.0:1788918538.396491:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855131520 00000100:00100000:0.0:1788918538.396550:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 246 00000100:00100000:0.0:1788918538.396560:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+12:9874:x1875816855131520:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788918538.396711:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+12:9874:x1875816855131520:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 152us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918538.396719:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 246 00000100:00100000:3.0:1788918538.427211:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918538.427559:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855131648 00000100:00100000:1.0:1788918538.427570:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855131648 00000100:00100000:1.0:1788918538.427633:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 247 00000100:00100000:1.0:1788918538.427643:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+12:5435:x1875816855131648:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788918538.427672:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918538.427691:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcbc5800/0x2811b8b2b0ac8f19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f03a7 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918538.427722:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcbc5800/0x2811b8b2b0ac8f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03a7 expref: 13 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918538.427734:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcbc5800/0x2811b8b2b0ac8f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03a7 expref: 13 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918538.427743:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5800, rc 0) 00000100:00100000:1.0:1788918538.427813:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:5435:x1875816855131648:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 171us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918538.427820:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 247 00000100:00100000:3.0:1788918538.434647:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918538.451940:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855131776 00000100:00100000:2.0:1788918538.451956:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855131776 00000100:00100000:2.0:1788918538.452410:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 248 00000100:00100000:2.0:1788918538.452422:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:5435:x1875816855131776:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788918538.452653:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:5435:x1875816855131776:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 232us (18013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918538.452901:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 248 00000100:00100000:3.0:1788918538.474163:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918538.474977:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855131904 00000100:00100000:0.0:1788918538.474988:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855131904 00000100:00100000:0.0:1788918538.475099:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 249 00000100:00100000:0.0:1788918538.475145:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:5435:x1875816855131904:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788918538.475307:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:5435:x1875816855131904:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 183us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918538.475316:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 249 00000100:00100000:3.0:1788918538.487429:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918538.488006:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855132032 00000100:00100000:1.0:1788918538.488071:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855132032 00000100:00100000:1.0:1788918538.488118:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 250 00000100:00100000:1.0:1788918538.488140:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:9877:x1875816855132032:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788918538.488296:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:9877:x1875816855132032:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 169us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918538.488303:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 250 00000100:00100000:3.0:1788918538.496157:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918538.496317:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855132160 00000100:00100000:2.0:1788918538.496327:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855132160 00000100:00100000:2.0:1788918538.496387:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 251 00000100:00100000:2.0:1788918538.496397:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:9877:x1875816855132160:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788918538.496563:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:9877:x1875816855132160:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 166us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918538.496580:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 251 00010000:00010000:2.0:1788918538.778471:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918538.838435:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865647488:0@lo:400:kworker.0 10000000:01000000:3.0:1788918538.838443:0:5921:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788918538.838447:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94ffef803800 from 7 10000000:01000000:3.0:1788918538.838450:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788918538.838484:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918538.838492:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865647360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788918538.838496:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918538.838507:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918538.838544:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865647616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788918538.838555:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865647232:0@lo:400:kworker.0 00000100:00100000:1.0:1788918538.838758:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918538.838868:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865647360 00000100:00100000:1.0:1788918538.838876:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865647360 00000100:00100000:1.0:1788918538.838930:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788918538.838940:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3418:x1875816865647360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918538.838981:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918538.839050:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3418:x1875816865647360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918538.839057:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788918538.839078:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788918538.839114:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865647360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918538.839193:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865647744:0@lo:400:kworker.0 00000100:00100000:1.0:1788918538.839221:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918538.839258:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865647744 00000100:00100000:1.0:1788918538.839263:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865647744 00000100:00100000:1.0:1788918538.839295:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788918538.839302:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865647744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918538.839337:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865647744:12345-0@lo:400:kworker.0 Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918538.839352:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788918538.839369:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918538.839386:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865647744:0@lo:400:kworker.0 00000100:00100000:1.0:1788918538.839411:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788918538.839417:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865647872:0@lo:400:kworker.0 00000100:00100000:1.0:1788918538.839442:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918538.839635:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865647872 00000100:00100000:1.0:1788918538.839641:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865647872 00000100:00100000:1.0:1788918538.839674:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788918538.839681:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865647872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918538.839719:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865647872:12345-0@lo:400:kworker.0 Request processed in 38us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918538.839726:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788918538.839742:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788918538.839759:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefcb1880 x1875816865647872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918538.839770:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865647872:0@lo:400:kworker.0 00000100:00100000:1.0:1788918538.839801:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865648000:0@lo:400:kworker.0 00000100:00100000:1.0:1788918538.839825:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918538.844980:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918538.845010:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918538.845131:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2fb840 going to sleep for 11 seconds 00000100:00100000:0.0:1788918538.845171:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918538.845229:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865648000 00000100:00100000:0.0:1788918538.845238:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865648000 00000100:00100000:0.0:1788918538.845293:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865647488 00000100:00100000:0.0:1788918538.845297:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865647488 00000100:00100000:0.0:1788918538.845317:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788918538.845327:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865648000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918538.845382:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865648000:12345-0@lo:400:kworker.0 Request processed in 57us (5555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918538.845389:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788918538.845406:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788918538.845413:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865647488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918538.845446:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865647488:12345-0@lo:400:kworker.0 Request processed in 34us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918538.845452:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788918538.845471:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918538.845616:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865647488:0@lo:400:kworker.0 00000100:00100000:0.0:1788918538.845653:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865648000:0@lo:400:kworker.0 00000100:00100000:0.0:1788918538.845783:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865647616 00000100:00100000:0.0:1788918538.845851:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865647616 00000100:00100000:0.0:1788918538.845922:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865647232 00000100:00100000:0.0:1788918538.845941:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865647232 00000100:00100000:2.0:1788918538.845981:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788918538.845991:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865647616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918538.846003:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918538.846040:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8f27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8f20 expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918538.846066:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8f27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8f20 expref: 18 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918538.846077:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8f27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8f20 expref: 18 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918538.846087:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd400, rc 0) 00000100:00100000:2.0:1788918538.846270:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865647616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 280us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918538.846276:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788918538.846303:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788918538.846309:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:3417:x1875816865647232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918538.846341:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:3417:x1875816865647232:12345-0@lo:400:kworker.0 Request processed in 33us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918538.846347:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788918538.846376:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865647232:0@lo:400:kworker.0 00000100:00100000:3.0:1788918538.846401:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865647616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918538.846428:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918538.846438:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918538.846516:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865648128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918538.846546:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918538.846710:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2fb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788918538.853650:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865648128 00000100:00100000:1.0:1788918538.853666:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865648128 00000100:00100000:2.0:1788918538.857263:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788918538.857289:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865648128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788918538.857680:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865648128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (11131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918538.857688:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788918538.857757:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865648128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918538.857840:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865648256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918538.857897:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918538.868853:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2fb840 going to sleep for 11 seconds 00000100:00100000:2.0:1788918538.868978:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865648256 00000100:00100000:2.0:1788918538.868989:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865648256 00000100:00100000:2.0:1788918538.869061:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788918538.869071:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffd8092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865648256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918538.869358:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffd8092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865648256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 287us (11459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918538.869366:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788918538.869440:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865648256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918538.870265:0:12044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:12044:1875816865648384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788918538.870316:0:12044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918538.870387:0:12044:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd80f8540 going to sleep for 11 seconds 00000100:00100000:3.0:1788918538.870429:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865648384 00000100:00100000:3.0:1788918538.870434:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865648384 00000100:00100000:3.0:1788918538.870457:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788918538.870602:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:12044:x1875816865648384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918538.870753:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:12044:x1875816865648384:12345-0@lo:502:llog_process_th.0 Request processed in 223us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918538.870770:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788918538.870907:0:12044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:12044:1875816865648384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788918538.870932:0:12044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918538.870942:0:12044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918538.870945:0:12044:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788918538.870951:0:12044:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94ffef803800 00000020:00000080:2.0:1788918538.870953:0:12044:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788918538.871172:0:12044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:12044:1875816865648512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788918538.871205:0:12044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918538.871241:0:12044:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd80f8540 going to sleep for 11 seconds 00000100:00100000:3.0:1788918538.871295:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865648512 00000100:00100000:3.0:1788918538.871299:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865648512 00000100:00100000:3.0:1788918538.871333:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788918538.871340:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:12044:x1875816865648512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918538.871403:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+17:12044:x1875816865648512:12345-0@lo:502:llog_process_th.0 Request processed in 63us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918538.871410:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788918538.871503:0:12044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:12044:1875816865648512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788918538.871521:0:12044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918538.871525:0:12044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918538.871527:0:12044:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788918538.871544:0:12044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788918538.871756:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788918538.871776:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788918538.871785:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918538.871808:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918538.871819:0:5921:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788918538.871821:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94fffcaac000 from 7 10000000:01000000:3.0:1788918538.871824:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788918538.871847:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918538.871855:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918538.871864:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918538.871877:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865648640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788918538.871913:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918538.872138:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2fb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918538.872239:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865648640 00000100:00100000:2.0:1788918538.872244:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865648640 00000100:00100000:2.0:1788918538.872273:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788918538.872279:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:5921:x1875816865648640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918538.872287:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918538.872300:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac8f35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8f2e expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918538.872322:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac8f35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8f2e expref: 18 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918538.872333:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac8f35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8f2e expref: 18 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918538.872342:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dc200, rc 0) 00000100:00100000:2.0:1788918538.872372:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865648640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918538.872378:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788918538.872478:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865648640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918538.872490:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918538.872500:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918538.875293:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865648768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918538.875355:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918538.875407:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2fb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918538.875574:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865648768 00000100:00100000:0.0:1788918538.875581:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865648768 00000100:00100000:0.0:1788918538.875728:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788918538.875739:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865648768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918538.875876:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865648768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918538.875883:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788918538.877920:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865648768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918538.878052:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865648896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918538.878112:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918538.878164:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2fb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918538.878192:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865648896 00000100:00100000:3.0:1788918538.878198:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865648896 00000100:00100000:3.0:1788918538.878232:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788918538.878240:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865648896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918538.878339:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865648896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918538.878346:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788918538.878390:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865648896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788918538.885276:0:12046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc874700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:12046:1875816865649024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918538.885356:0:12046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918538.886925:0:12046:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc894de40 going to sleep for 11 seconds 00000040:00080000:3.0:1788918538.891052:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788918538.891177:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865649024 00000100:00100000:1.0:1788918538.891188:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865649024 00000100:00100000:1.0:1788918538.891242:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788918538.891253:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:12046:x1875816865649024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918538.891412:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+18:12046:x1875816865649024:12345-0@lo:502:llog_process_th.0 Request processed in 161us (6055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918538.891420:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788918538.891918:0:12046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc874700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:12046:1875816865649024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788918538.891953:0:12046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788918538.892721:0:12046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918538.892725:0:12046:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788918538.892735:0:12046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94fffcaac000 00000020:00000080:0.0:1788918538.892738:0:12046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788918538.892907:0:12046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc874700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:12046:1875816865649152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918538.892967:0:12046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918538.894095:0:12046:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc894de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788918538.894170:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865649152 00000100:00100000:1.0:1788918538.894177:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865649152 00000100:00100000:1.0:1788918538.894221:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788918538.894230:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe9ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:12046:x1875816865649152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918538.894349:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe9ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:12046:x1875816865649152:12345-0@lo:502:llog_process_th.0 Request processed in 119us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918538.894356:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788918538.894950:0:12046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc874700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:12046:1875816865649152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788918538.895178:0:12046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788918538.895185:0:12046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918538.895187:0:12046:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788918538.895192:0:12046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788918538.896105:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788918538.896145:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788918538.896156:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918538.896167:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918538.896178:0:5921:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788918538.896181:0:5921:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94fffbe70000 from 7 10000000:01000000:1.0:1788918538.896184:0:5921:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788918538.896220:0:5921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918538.896228:0:5921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918538.896237:0:5921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918538.896270:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865649280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788918538.896323:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918538.896358:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc531d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918538.896807:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865649280 00000100:00100000:0.0:1788918538.896814:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865649280 00000100:00100000:0.0:1788918538.896860:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788918538.896869:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+18:5921:x1875816865649280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788918538.896882:0:5918:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918538.896894:0:5918:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcb20e00/0x2811b8b2b0ac8f43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac8f3c expref: -99 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918538.896917:0:5918:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcb20e00/0x2811b8b2b0ac8f43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8f3c expref: 19 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918538.896927:0:5918:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcb20e00/0x2811b8b2b0ac8f43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac8f3c expref: 19 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918538.896936:0:5918:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20e00, rc 0) 00000100:00100000:0.0:1788918538.897109:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865649280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918538.897116:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788918538.897210:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865649280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918538.897225:0:5921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918538.897235:0:5921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918538.897296:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865649408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918538.897325:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918538.897355:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918538.897399:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865649408 00000100:00100000:0.0:1788918538.897403:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865649408 00000100:00100000:0.0:1788918538.897437:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788918538.897444:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865649408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918538.897696:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865649408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918538.897703:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788918538.897861:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865649408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918538.897887:0:5921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865649536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918538.897926:0:5921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918538.897955:0:5921:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918538.898133:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865649536 00000100:00100000:0.0:1788918538.898138:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865649536 00000100:00100000:0.0:1788918538.898160:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788918538.898167:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865649536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788918538.898246:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:5921:x1875816865649536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918538.898258:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788918538.898367:0:5921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74aa73a2-313d-4992-b461-72ab8c3ab246:5921:1875816865649536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788918538.906344:0:12049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:12049:1875816865649664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918538.906426:0:12049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918538.907919:0:12049:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc531d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788918538.911650:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865649664 00000100:00100000:0.0:1788918538.911665:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865649664 00000100:00100000:0.0:1788918538.912576:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788918538.912588:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:12049:x1875816865649664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918538.912767:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:12049:x1875816865649664:12345-0@lo:502:llog_process_th.0 Request processed in 182us (6340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918538.912775:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788918538.912871:0:12049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:12049:1875816865649664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788918538.912908:0:12049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918538.912917:0:12049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918538.912919:0:12049:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788918538.912926:0:12049:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94fffbe70000 00000020:00000080:2.0:1788918538.912933:0:12049:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788918538.913268:0:12049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:12049:1875816865649792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788918538.913312:0:12049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918538.914715:0:12049:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd80f8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788918538.914803:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865649792 00000100:00100000:1.0:1788918538.914811:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865649792 00000100:00100000:1.0:1788918538.914852:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788918538.914862:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:12049:x1875816865649792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918538.915187:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:12049:x1875816865649792:12345-0@lo:502:llog_process_th.0 Request processed in 325us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918538.915194:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788918538.915297:0:12049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74aa73a2-313d-4992-b461-72ab8c3ab246:12049:1875816865649792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788918538.915325:0:12049:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918538.915332:0:12049:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918538.915334:0:12049:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788918538.915337:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788918538.915396:0:5921:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788918538.915417:0:5921:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788918538.915426:0:5921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918538.915437:0:5921:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918539.436512:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918539.436557:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918539.436595:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918539.436629:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918539.436632:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855132416 00000100:00100000:1.0:1788918539.436641:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855132416 00000100:00100000:1.0:1788918539.436710:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855132672 00000100:00100000:1.0:1788918539.436714:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855132672 00000100:00100000:1.0:1788918539.436743:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 95 00000100:00100000:1.0:1788918539.436752:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855132416:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918539.436843:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855132416:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 91us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918539.436850:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 95 00000100:00100000:1.0:1788918539.436869:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 96 00000100:00100000:1.0:1788918539.436876:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2352:x1875816855132672:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918539.436921:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2352:x1875816855132672:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 45us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918539.436928:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 96 00000100:00080000:3.0:1788918539.436939:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918539.437241:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855132288 00000100:00100000:0.0:1788918539.437246:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855132288 00000100:00100000:0.0:1788918539.437285:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 268 00000100:00100000:0.0:1788918539.437292:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855132288:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918539.437335:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855132288:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 44us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918539.437342:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 268 00000100:00100000:0.0:1788918539.437372:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855132544 00000100:00100000:0.0:1788918539.437376:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855132544 00000100:00100000:0.0:1788918539.437408:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:0.0:1788918539.437415:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855132544:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918539.437441:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855132544:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 26us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918539.437447:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00080000:3.0:1788918539.438012:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788918539.799386:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918539.864941:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788918539.864963:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865649920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918539.865056:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918539.865238:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865649920 00000100:00100000:2.0:1788918539.865246:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865649920 00000100:00100000:2.0:1788918539.865309:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788918539.865319:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865649920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918539.865345:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918539.865403:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865649920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918539.865409:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788918539.865494:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefc35c00 x1875816865649920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918539.865512:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865649920:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788918539.930299:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788918540.829533:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918541.848569:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918542.870237:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788918542.936163:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1788918543.894420:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918543.958376:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865650048:0@lo:400:kworker.0 00000100:00100000:3.0:1788918543.958480:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918543.958611:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865650048 00000100:00100000:0.0:1788918543.958630:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865650048 00000100:00100000:0.0:1788918543.958824:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788918543.958835:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865650048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918543.961956:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865650560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918543.962085:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918543.962249:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865650432:0@lo:400:kworker.0 00000100:00100000:1.0:1788918543.962287:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918543.962332:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865650432 00000100:00100000:1.0:1788918543.962341:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865650432 00000100:00100000:1.0:1788918543.962411:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788918543.962420:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865650432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918543.962481:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865650432:12345-0@lo:400:kworker.0 Request processed in 63us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918543.962489:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788918543.962511:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788918543.962547:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff7fb480 x1875816865650432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918543.962564:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865650432:0@lo:400:kworker.0 00000100:00100000:1.0:1788918543.962610:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865650304:0@lo:400:kworker.0 00000100:00100000:1.0:1788918543.962640:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918543.962662:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788918543.962670:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865650176:0@lo:400:kworker.0 00000100:00100000:1.0:1788918543.962721:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918543.962742:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865650688:0@lo:400:kworker.0 00000100:00100000:1.0:1788918543.963780:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918543.963823:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865650304 00000100:00100000:1.0:1788918543.963829:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865650304 00000100:00100000:1.0:1788918543.963874:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865650176 00000100:00100000:1.0:1788918543.963877:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865650176 00000100:00100000:1.0:1788918543.963890:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865650688 00000100:00100000:1.0:1788918543.963892:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865650688 00000100:00100000:1.0:1788918543.963905:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788918543.963911:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865650304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918543.963955:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865650304:12345-0@lo:400:kworker.0 Request processed in 44us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918543.963963:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788918543.963978:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788918543.963984:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865650176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918543.964012:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865650176:12345-0@lo:400:kworker.0 Request processed in 29us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918543.964032:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788918543.964045:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788918543.964052:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865650688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918543.964096:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865650688:12345-0@lo:400:kworker.0 Request processed in 45us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918543.964102:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788918543.964120:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918543.964144:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865650176:0@lo:400:kworker.0 00000100:00100000:1.0:1788918543.964155:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865650688:0@lo:400:kworker.0 00000100:00100000:1.0:1788918543.964164:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865650304:0@lo:400:kworker.0 00000100:00100000:1.0:1788918543.964245:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865650560 00000100:00100000:1.0:1788918543.964250:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865650560 00000100:00100000:1.0:1788918543.964285:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788918543.964293:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865650560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918543.964321:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918543.964357:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865650560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918543.964364:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788918543.964382:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788918543.967779:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865650048:12345-0@lo:400:kworker.0 Request processed in 8934us (9286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918543.967805:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788918543.970208:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865650048:0@lo:400:kworker.0 00000100:00100000:3.0:1788918543.970272:0:3420:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788918543.970281:0:3420:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94ffe8d80a80, transno 4294967300 00000100:00100000:3.0:1788918543.970315:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865650560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918544.581554:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918544.581624:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918544.581663:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918544.581702:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918544.581829:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855133056 00000100:00100000:0.0:1788918544.581845:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855133056 00000100:00100000:1.0:1788918544.581969:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855132800 00000100:00100000:0.0:1788918544.581970:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:0.0:1788918544.581987:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2349:x1875816855133056:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918544.581992:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855132800 00000100:00100000:1.0:1788918544.582101:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 270 00000100:00100000:1.0:1788918544.582113:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855132800:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918544.582153:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2349:x1875816855133056:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 169us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918544.582162:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:1.0:1788918544.582177:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855132800:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 64us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918544.582188:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 270 00000100:00100000:0.0:1788918544.582207:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855132928 00000100:00100000:0.0:1788918544.582214:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855132928 00000100:00100000:0.0:1788918544.582256:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855133184 00000100:00100000:0.0:1788918544.582260:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855133184 00000100:00100000:0.0:1788918544.582289:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00100000:0.0:1788918544.582300:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2350:x1875816855132928:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918544.582341:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2350:x1875816855132928:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 44us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918544.582349:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00100000:0.0:1788918544.582363:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 101 00000100:00100000:0.0:1788918544.582369:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2350:x1875816855133184:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918544.582400:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2350:x1875816855133184:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 28us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918544.582407:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 101 00000100:00080000:3.0:1788918544.582649:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788918544.582657:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788918544.920615:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918544.984533:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865650816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918544.984614:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918544.984841:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865650816 00000100:00100000:2.0:1788918544.984849:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865650816 00000100:00100000:2.0:1788918544.984912:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788918544.984921:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865650816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918544.984953:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00010000:00080000:3.0:1788918544.985237:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefc35f80 x1875816865650816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918544.985258:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865650816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788918544.985372:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865650816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 451us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918544.985380:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:2.0:1788918545.946109:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918546.966366:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918547.992107:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918549.014451:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918549.078848:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefdde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865650944:0@lo:400:kworker.0 00000100:00100000:3.0:1788918549.078926:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918549.078981:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865651456:0@lo:400:kworker.0 00000100:00100000:3.0:1788918549.079008:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918549.079076:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788918549.079083:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865651072:0@lo:400:kworker.0 00000100:00100000:3.0:1788918549.079108:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918549.079140:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865651584:0@lo:400:kworker.0 00000100:00100000:3.0:1788918549.079166:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918549.079191:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefdded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865651200:0@lo:400:kworker.0 00000100:00100000:3.0:1788918549.079212:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918549.079226:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788918549.079232:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865651328:0@lo:400:kworker.0 00000100:00100000:3.0:1788918549.079253:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918549.079906:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865651456 00000100:00100000:2.0:1788918549.079913:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865651456 00000100:00100000:2.0:1788918549.079963:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865651072 00000100:00100000:2.0:1788918549.079967:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865651072 00000100:00100000:2.0:1788918549.079979:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865651200 00000100:00100000:2.0:1788918549.079981:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865651200 00000100:00100000:2.0:1788918549.079998:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788918549.080007:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865651456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918549.080247:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865651456:12345-0@lo:400:kworker.0 Request processed in 240us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918549.080254:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788918549.080269:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788918549.080274:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865651072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918549.080298:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865651072:12345-0@lo:400:kworker.0 Request processed in 24us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918549.080311:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788918549.080321:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788918549.080326:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865651200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918549.080348:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865651200:12345-0@lo:400:kworker.0 Request processed in 22us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918549.080353:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1788918549.080367:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918549.080373:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788918549.080382:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865651712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918549.080405:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918549.080611:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865651072:0@lo:400:kworker.0 00000100:00100000:2.0:1788918549.080621:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865651456:0@lo:400:kworker.0 00000100:00100000:1.0:1788918549.081368:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865650944 00000100:00100000:1.0:1788918549.081374:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865650944 00000100:00100000:1.0:1788918549.081414:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788918549.081421:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865650944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918549.081476:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865650944:12345-0@lo:400:kworker.0 Request processed in 56us (2549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918549.081482:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788918549.081512:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865651584 00000100:00100000:1.0:1788918549.081521:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865651584 00000100:00100000:1.0:1788918549.081557:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865651328 00000100:00100000:1.0:1788918549.081559:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865651328 00000100:00100000:1.0:1788918549.081577:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788918549.081582:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865651584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918549.081608:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865651584:12345-0@lo:400:kworker.0 Request processed in 26us (2441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918549.081614:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788918549.081622:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788918549.081627:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865651328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918549.081647:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865651328:12345-0@lo:400:kworker.0 Request processed in 21us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918549.081653:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788918549.081672:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865651712 00000100:00100000:1.0:1788918549.081674:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865651712 00000100:00100000:1.0:1788918549.081693:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788918549.081698:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865651712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918549.081739:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918549.081769:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865651712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918549.081776:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788918549.081792:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788918549.081794:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788918549.081816:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865651712:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788918549.082237:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefddce00 x1875816865651328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918549.082249:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865651328:0@lo:400:kworker.0 00000100:00100000:3.0:1788918549.082260:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefdded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865651200:0@lo:400:kworker.0 00000100:00100000:2.0:1788918549.082664:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865651584:0@lo:400:kworker.0 00000100:00100000:2.0:1788918549.082676:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefdde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865650944:0@lo:400:kworker.0 00000040:00080000:2.0:1788918549.144349:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788918549.686657:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918549.686699:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918549.686740:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918549.686771:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918549.686907:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855133440 00000100:00100000:0.0:1788918549.686917:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855133440 00000100:00100000:0.0:1788918549.686978:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855133696 00000100:00100000:0.0:1788918549.686980:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855133696 00000100:00100000:0.0:1788918549.686997:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 105 00000100:00100000:0.0:1788918549.687006:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2349:x1875816855133440:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918549.687122:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2349:x1875816855133440:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 117us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918549.687129:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 105 00000100:00100000:0.0:1788918549.687147:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 106 00000100:00100000:0.0:1788918549.687153:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855133696:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918549.687171:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855133696:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 19us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918549.687177:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 106 00000100:00100000:2.0:1788918549.687406:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855133568 00000100:00100000:2.0:1788918549.687411:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855133568 00000100:00100000:2.0:1788918549.687447:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:2.0:1788918549.687454:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2349:x1875816855133568:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918549.687482:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2349:x1875816855133568:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 29us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918549.687488:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:1.0:1788918549.690161:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855133312 00000100:00100000:1.0:1788918549.690176:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855133312 00000100:00100000:1.0:1788918549.690258:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 272 00000100:00100000:1.0:1788918549.690267:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855133312:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918549.690343:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855133312:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 76us (3694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918549.690351:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 272 00000100:00080000:3.0:1788918549.691676:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788918549.691684:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788918550.039004:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918550.108705:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865651840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918550.108787:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918550.108981:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865651840 00000100:00100000:2.0:1788918550.108989:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865651840 00000100:00100000:2.0:1788918550.109097:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788918550.109107:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865651840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918550.109137:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918550.109193:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865651840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918550.109200:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788918550.109462:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefc35500 x1875816865651840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918550.109482:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865651840:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788918551.062208:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918552.087828:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918553.110353:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918554.140860:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918554.198751:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865652224:0@lo:400:kworker.0 00000100:00100000:1.0:1788918554.198819:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918554.198883:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788918554.198889:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865652352:0@lo:400:kworker.0 00000100:00100000:1.0:1788918554.198914:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918554.198949:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865652224 00000100:00100000:1.0:1788918554.198956:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865652224 00000100:00100000:1.0:1788918554.199043:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788918554.199053:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefdddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865652224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918554.199102:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefdddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865652224:12345-0@lo:400:kworker.0 Request processed in 52us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918554.199110:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788918554.199132:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865652352 00000100:00100000:1.0:1788918554.199135:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865652352 00000100:00100000:1.0:1788918554.199161:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788918554.199167:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865652352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918554.199195:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865652352:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918554.199201:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788918554.199216:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788918554.199220:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788918554.199266:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefddd880 x1875816865652352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918554.199280:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865652352:0@lo:400:kworker.0 00000100:00100000:1.0:1788918554.199291:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865652224:0@lo:400:kworker.0 00000100:00100000:0.0:1788918554.199475:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865652096:0@lo:400:kworker.0 00000100:00100000:0.0:1788918554.199505:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918554.199532:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefdddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865652608:0@lo:400:kworker.0 00000100:00100000:0.0:1788918554.199552:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918554.199574:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788918554.199580:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865651968:0@lo:400:kworker.0 00000100:00100000:0.0:1788918554.199605:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918554.199626:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefdde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865652480:0@lo:400:kworker.0 00000100:00100000:0.0:1788918554.199655:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918554.199680:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865651968 00000100:00100000:0.0:1788918554.199684:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865651968 00000100:00100000:0.0:1788918554.199710:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788918554.199716:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865651968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918554.199749:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865651968:12345-0@lo:400:kworker.0 Request processed in 33us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918554.199755:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788918554.199781:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865652096 00000100:00100000:0.0:1788918554.199785:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865652096 00000100:00100000:0.0:1788918554.199801:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865652480 00000100:00100000:0.0:1788918554.199804:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865652480 00000100:00100000:0.0:1788918554.199822:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788918554.199827:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865652096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918554.199857:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865652096:12345-0@lo:400:kworker.0 Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918554.199862:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788918554.199873:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788918554.199878:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865652480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918554.199902:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865652480:12345-0@lo:400:kworker.0 Request processed in 24us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918554.199907:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788918554.199931:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865651968:0@lo:400:kworker.0 00000100:00100000:0.0:1788918554.199941:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefdde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865652480:0@lo:400:kworker.0 00000100:00100000:0.0:1788918554.199948:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865652096:0@lo:400:kworker.0 00000100:00100000:2.0:1788918554.200065:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865652608 00000100:00100000:2.0:1788918554.200069:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865652608 00000100:00100000:2.0:1788918554.200093:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788918554.200100:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865652608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918554.200140:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865652608:12345-0@lo:400:kworker.0 Request processed in 41us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918554.200146:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788918554.200171:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefdddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865652608:0@lo:400:kworker.0 00000100:00100000:1.0:1788918554.200665:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788918554.200676:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865652736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918554.200706:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788918554.200740:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788918554.200743:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918554.201306:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865652736 00000100:00100000:2.0:1788918554.201311:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865652736 00000100:00100000:2.0:1788918554.201353:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788918554.201361:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865652736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788918554.201387:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918554.201443:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865652736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918554.201462:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788918554.207145:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865652736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918554.806287:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918554.806337:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918554.806548:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855133824 00000100:00100000:2.0:1788918554.806559:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855133824 00000100:00100000:2.0:1788918554.806618:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 274 00000100:00100000:2.0:1788918554.806628:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855133824:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918554.806704:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855133824:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 77us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918554.806712:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 274 00000100:00100000:0.0:1788918554.807267:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855133952 00000100:00100000:0.0:1788918554.807272:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855133952 00000100:00100000:0.0:1788918554.807324:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 110 00000100:00100000:0.0:1788918554.807332:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+5:2351:x1875816855133952:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918554.807370:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+5:2351:x1875816855133952:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 39us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918554.807375:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 110 00000100:00080000:1.0:1788918554.807463:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918554.867519:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918554.867576:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918554.867685:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855134208 00000100:00100000:2.0:1788918554.867695:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855134208 00000100:00100000:2.0:1788918554.867784:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 111 00000100:00100000:2.0:1788918554.867794:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2352:x1875816855134208:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918554.867877:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2352:x1875816855134208:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918554.867884:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 111 00000100:00100000:1.0:1788918554.868392:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855134080 00000100:00100000:1.0:1788918554.868397:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855134080 00000100:00100000:1.0:1788918554.868440:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:1.0:1788918554.868447:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2348:x1875816855134080:12345-192.168.202.49@tcp:9:kworker.0 00000020:00000080:1.0:1788918554.868467:0:6911:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8e7f 00000100:00080000:1.0:1788918554.868475:0:6911:0:(import.c:65:import_set_state_nolock()) ffff94ffefe1b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788918554.868519:0:6911:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788918554.868643:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+2:2348:x1875816855134080:12345-192.168.202.49@tcp:9:kworker.0 Request processed in 196us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918554.868651:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00010000:00010000:1.0:1788918554.868669:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788918554.870373:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788918554.870392:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788918555.158361:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918555.222797:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788918555.222832:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865652864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918555.222902:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918555.223155:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865652864 00000100:00100000:2.0:1788918555.223164:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865652864 00000100:00100000:2.0:1788918555.223222:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788918555.223232:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865652864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918555.223259:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918555.223315:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865652864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918555.223322:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788918555.225213:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefc35c00 x1875816865652864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918555.225275:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865652864:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788918556.185147:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918557.207079:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918558.230468:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918559.274228:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918559.321992:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865652992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918559.322075:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918559.322129:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865653504:0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.322167:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918559.322193:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788918559.322200:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5370000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865653120:0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.322225:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918559.322246:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865653632:0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.322271:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918559.322296:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865653376:0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.322324:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918559.322342:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788918559.322347:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865653248:0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.322370:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918559.322387:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865653760:0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.322405:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918559.322430:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865652992 00000100:00100000:3.0:1788918559.322437:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865652992 00000100:00100000:3.0:1788918559.322489:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788918559.322498:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865652992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788918559.322526:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918559.322568:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865652992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918559.322587:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788918559.322610:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865653504 00000100:00100000:3.0:1788918559.322614:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865653504 00000100:00100000:3.0:1788918559.322641:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865653760 00000100:00100000:3.0:1788918559.322644:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865653760 00000100:00100000:3.0:1788918559.322662:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788918559.322668:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865653504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.322699:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865653504:12345-0@lo:400:kworker.0 Request processed in 31us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918559.322706:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788918559.322715:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788918559.322720:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865653760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.322746:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865653760:12345-0@lo:400:kworker.0 Request processed in 25us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918559.322751:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788918559.322767:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865653120 00000100:00100000:3.0:1788918559.322770:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865653120 00000100:00100000:3.0:1788918559.322794:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788918559.322800:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865653120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.322828:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865653120:12345-0@lo:400:kworker.0 Request processed in 28us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918559.322833:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788918559.322859:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865653632 00000100:00100000:3.0:1788918559.322862:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865653632 00000100:00100000:3.0:1788918559.322882:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865653376 00000100:00100000:3.0:1788918559.322885:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865653376 00000100:00100000:3.0:1788918559.322894:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865653248 00000100:00100000:3.0:1788918559.322904:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865653248 00000100:00100000:3.0:1788918559.322923:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788918559.322930:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865653632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.322968:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865653632:12345-0@lo:400:kworker.0 Request processed in 39us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918559.322974:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788918559.322986:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788918559.322991:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865653376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.323016:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865653376:12345-0@lo:400:kworker.0 Request processed in 26us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918559.323046:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788918559.323058:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788918559.323063:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865653248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.323089:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865653248:12345-0@lo:400:kworker.0 Request processed in 26us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918559.323094:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1788918559.323118:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788918559.323123:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788918559.323125:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788918559.323164:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865653248:0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.323176:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865653760:0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.323184:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865653376:0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.323206:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5370000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865653120:0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.323215:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865653632:0@lo:400:kworker.0 00000100:00100000:3.0:1788918559.323240:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865652992:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788918559.323251:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffc5372a00 x1875816865653504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918559.323261:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865653504:0@lo:400:kworker.0 00000040:00080000:0.0:1788918559.450683:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788918559.919270:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918559.919318:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918559.919375:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918559.919408:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855134336 00000100:00100000:1.0:1788918559.919421:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855134336 00000100:00100000:1.0:1788918559.919480:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 276 00000100:00100000:1.0:1788918559.919491:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855134336:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918559.919595:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855134336:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 105us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918559.919603:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 276 00000100:00100000:1.0:1788918559.919645:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855134592 00000100:00100000:1.0:1788918559.919649:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855134592 00000100:00100000:1.0:1788918559.919691:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855134464 00000100:00100000:1.0:1788918559.919694:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855134464 00000100:00100000:1.0:1788918559.919731:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 115 00000100:00100000:1.0:1788918559.919739:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855134592:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918559.919773:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855134592:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 36us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918559.919780:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 115 00000100:00100000:1.0:1788918559.919792:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 116 00000100:00100000:1.0:1788918559.919799:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefdddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2349:x1875816855134464:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918559.919824:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefdddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2349:x1875816855134464:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918559.919830:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 116 00000100:00080000:1.0:1788918559.919996:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788918560.287177:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918560.343077:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865653888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918560.343177:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918560.343327:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865653888 00000100:00100000:2.0:1788918560.343338:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865653888 00000100:00100000:2.0:1788918560.343410:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788918560.343422:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865653888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918560.343468:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918560.343542:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865653888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918560.343549:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788918560.343729:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefc35f80 x1875816865653888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918560.343752:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865653888:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788918560.861398:0:7980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00000020:00000080:0.0:1788918560.861412:0:7980:0:(genops.c:885:class_export_put()) final put ffff94ffefe1b800/9b921db9-4859-438b-976e-b950f67eace4 00000020:00000080:3.0:1788918560.868923:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffefe1b800/9b921db9-4859-438b-976e-b950f67eace4 for lustre-OST0001 00000020:00000080:3.0:1788918560.869015:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffefe1b000 for lustre-OST0001 00010000:00010000:0.0:1788918561.302903:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918562.331751:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918563.351722:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918564.374226:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918564.440858:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865654144:0@lo:400:kworker.0 00000100:00100000:0.0:1788918564.440940:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918564.440999:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865654656:0@lo:400:kworker.0 00000100:00100000:0.0:1788918564.441046:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918564.441077:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788918564.441083:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865654016:0@lo:400:kworker.0 00000100:00100000:0.0:1788918564.441124:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918564.441164:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865654528:0@lo:400:kworker.0 00000100:00100000:0.0:1788918564.441188:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918564.441217:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865654272:0@lo:400:kworker.0 00000100:00100000:0.0:1788918564.441242:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918564.441262:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788918564.441267:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865654400:0@lo:400:kworker.0 00000100:00100000:0.0:1788918564.441288:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918564.441321:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865654144 00000100:00100000:0.0:1788918564.441328:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865654144 00000100:00100000:0.0:1788918564.441370:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865654528 00000100:00100000:0.0:1788918564.441374:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865654528 00000100:00100000:0.0:1788918564.441397:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865654272 00000100:00100000:0.0:1788918564.441400:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865654272 00000100:00100000:0.0:1788918564.441415:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788918564.441424:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865654144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918564.441476:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865654144:12345-0@lo:400:kworker.0 Request processed in 51us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918564.441484:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788918564.441503:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788918564.441510:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865654528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918564.441537:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865654528:12345-0@lo:400:kworker.0 Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918564.441543:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788918564.441555:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788918564.441560:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865654272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918564.441590:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865654272:12345-0@lo:400:kworker.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918564.441605:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1788918564.441629:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918564.441660:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865654272:0@lo:400:kworker.0 00000100:00100000:0.0:1788918564.441689:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865654528:0@lo:400:kworker.0 00000100:00100000:0.0:1788918564.441698:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865654144:0@lo:400:kworker.0 00000100:00100000:3.0:1788918564.441908:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865654656 00000100:00100000:3.0:1788918564.441913:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865654656 00000100:00100000:3.0:1788918564.441962:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865654400 00000100:00100000:3.0:1788918564.441965:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865654400 00000100:00100000:3.0:1788918564.441984:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788918564.441991:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865654656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918564.442057:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865654656:12345-0@lo:400:kworker.0 Request processed in 66us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918564.442063:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788918564.442077:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788918564.442084:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865654400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918564.442123:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865654400:12345-0@lo:400:kworker.0 Request processed in 41us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918564.442130:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788918564.442147:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865654016 00000100:00100000:3.0:1788918564.442151:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865654016 00000100:00100000:3.0:1788918564.442176:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788918564.442191:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865654016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918564.442223:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865654016:12345-0@lo:400:kworker.0 Request processed in 33us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918564.442229:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788918564.442277:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865654016:0@lo:400:kworker.0 00000100:00100000:3.0:1788918564.442289:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865654656:0@lo:400:kworker.0 00000100:00100000:1.0:1788918564.442710:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788918564.442722:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865654784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918564.442770:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918564.442801:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865654784 00000100:00100000:1.0:1788918564.442805:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865654784 00000100:00100000:1.0:1788918564.442837:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788918564.442844:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefdde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865654784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918564.442867:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918564.442914:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefdde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865654784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918564.442920:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788918564.442955:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865654784:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788918564.445813:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788918564.445823:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788918564.445895:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffe8d81500 x1875816865654400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918564.445914:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865654400:0@lo:400:kworker.0 00000100:00100000:1.0:1788918565.363008:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918565.363100:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918565.363141:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918565.363277:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855134848 00000100:00100000:2.0:1788918565.363296:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855134848 00000100:00100000:0.0:1788918565.363332:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855134976 00000100:00100000:0.0:1788918565.363342:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855134976 00000100:00100000:2.0:1788918565.363409:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00100000:2.0:1788918565.363427:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2350:x1875816855134848:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918565.363433:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855134720 00000100:00100000:3.0:1788918565.363440:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855134720 00000100:00100000:3.0:1788918565.363485:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 278 00000100:00100000:3.0:1788918565.363496:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2350:x1875816855134720:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918565.363533:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2350:x1875816855134848:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 110us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918565.363542:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00100000:3.0:1788918565.363559:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2350:x1875816855134720:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 62us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918565.363573:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 121 00000100:00100000:3.0:1788918565.363574:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 278 00000100:00100000:2.0:1788918565.363597:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855134976:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918565.363640:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855134976:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 52us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918565.363648:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 121 00000100:00080000:1.0:1788918565.363767:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788918565.398233:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918565.462659:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865654912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918565.462770:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918565.463048:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865654912 00000100:00100000:3.0:1788918565.463061:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865654912 00000100:00100000:3.0:1788918565.463131:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788918565.463142:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefdde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865654912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788918565.463183:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918565.463244:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefdde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865654912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918565.463252:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788918565.463985:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff731880 x1875816865654912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918565.464042:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865654912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788918566.422363:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918567.569106:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788918567.955157:0:12208:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:49:23 (1788918563) 00010000:00010000:1.0:1788918568.611582:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918569.558568:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865655424:0@lo:400:kworker.0 00000100:00100000:0.0:1788918569.558640:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918569.558785:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788918569.558792:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865655296:0@lo:400:kworker.0 00000100:00100000:0.0:1788918569.558822:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918569.559235:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865655168:0@lo:400:kworker.0 00000100:00100000:1.0:1788918569.559266:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918569.559284:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865655680:0@lo:400:kworker.0 00000100:00100000:1.0:1788918569.559461:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918569.559485:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788918569.559492:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865655040:0@lo:400:kworker.0 00000100:00100000:1.0:1788918569.559539:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918569.559562:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865655552:0@lo:400:kworker.0 00000100:00100000:1.0:1788918569.559584:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918569.559616:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865655296 00000100:00100000:1.0:1788918569.559623:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865655296 00000100:00100000:1.0:1788918569.559746:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865655168 00000100:00100000:1.0:1788918569.559751:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865655168 00000100:00100000:1.0:1788918569.559765:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865655552 00000100:00100000:1.0:1788918569.559768:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865655552 00000100:00100000:1.0:1788918569.559785:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788918569.559794:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865655296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918569.559856:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865655296:12345-0@lo:400:kworker.0 Request processed in 63us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918569.559863:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788918569.559880:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788918569.559887:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865655168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918569.559920:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865655168:12345-0@lo:400:kworker.0 Request processed in 33us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918569.559926:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788918569.559936:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788918569.559942:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865655552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918569.559966:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865655552:12345-0@lo:400:kworker.0 Request processed in 24us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918569.559971:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1788918569.559985:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918569.560903:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865655296:0@lo:400:kworker.0 00000100:00100000:0.0:1788918569.560932:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788918569.560944:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865655808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918569.560988:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918569.561940:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865655552:0@lo:400:kworker.0 00000100:00100000:1.0:1788918569.561976:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865655168:0@lo:400:kworker.0 00000100:00100000:3.0:1788918569.562196:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865655424 00000100:00100000:3.0:1788918569.562204:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865655424 00000100:00100000:3.0:1788918569.562268:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865655680 00000100:00100000:3.0:1788918569.562272:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865655680 00000100:00100000:3.0:1788918569.562291:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788918569.562559:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865655424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918569.562621:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865655424:12345-0@lo:400:kworker.0 Request processed in 65us (3980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918569.562627:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788918569.562705:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788918569.562725:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefdded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865655680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918569.562756:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefdded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865655680:12345-0@lo:400:kworker.0 Request processed in 43us (3296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918569.562763:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788918569.562784:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865655040 00000100:00100000:3.0:1788918569.562788:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865655040 00000100:00100000:3.0:1788918569.562811:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788918569.562817:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865655040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918569.562856:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865655040:12345-0@lo:400:kworker.0 Request processed in 39us (3316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918569.562862:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788918569.562895:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865655808 00000100:00100000:3.0:1788918569.562899:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865655808 00000100:00100000:3.0:1788918569.562920:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788918569.562926:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865655808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788918569.562948:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918569.562979:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865655808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918569.562985:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788918569.563606:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865655040:0@lo:400:kworker.0 00000100:00100000:1.0:1788918569.563621:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865655680:0@lo:400:kworker.0 00000100:00100000:3.0:1788918569.563824:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865655808:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788918569.563848:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff733100 x1875816865655424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918569.563871:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865655424:0@lo:400:kworker.0 00000100:00080000:0.0:1788918569.564042:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788918569.564047:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788918569.624255:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788918569.686859:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788918570.158249:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918570.158370:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855135232 00000100:00100000:2.0:1788918570.158387:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855135232 00000100:00100000:1.0:1788918570.158439:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918570.158502:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 125 00000100:00100000:2.0:1788918570.158519:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2350:x1875816855135232:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918570.158636:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2350:x1875816855135232:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 122us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918570.158646:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 125 00000100:00100000:3.0:1788918570.158960:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855135104 00000100:00100000:3.0:1788918570.158965:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855135104 00000100:00100000:3.0:1788918570.159002:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 280 00000100:00100000:3.0:1788918570.159009:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2350:x1875816855135104:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918570.159100:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2350:x1875816855135104:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 91us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918570.159461:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 280 00000100:00080000:3.0:1788918570.159494:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918570.203725:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918570.207357:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855135360 00000100:00100000:0.0:1788918570.207373:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855135360 00000100:00100000:0.0:1788918570.207470:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 126 00000100:00100000:0.0:1788918570.207482:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2350:x1875816855135360:12345-192.168.202.49@tcp:400:kworker.0 00000100:00080000:1.0:1788918570.207494:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918570.207571:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2350:x1875816855135360:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 90us (3858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918570.207579:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 126 00000100:00100000:3.0:1788918570.582807:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865655936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918570.582924:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918570.583695:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865655936 00000100:00100000:0.0:1788918570.583706:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865655936 00000100:00100000:0.0:1788918570.584274:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788918570.584289:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865655936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788918570.584331:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918570.584403:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865655936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918570.584411:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788918570.584527:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff733100 x1875816865655936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918570.584552:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865655936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788918570.646488:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918571.677011:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918572.622288:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918572.622376:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855135488 00000100:00100000:2.0:1788918572.622386:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855135488 00000100:00100000:2.0:1788918572.622455:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:2.0:1788918572.622464:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+5:10147:x1875816855135488:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788918572.622482:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918572.622503:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac8f4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f03ae expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.622569:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac8f51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.622581:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac8f51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.622593:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac8f51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918572.622634:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788918572.622637:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918572.622681:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac8f51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.622703:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac8f4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03ae expref: 7 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.622740:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac8f51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03ae expref: 6 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.622748:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fffbdf3700) 00010000:00010000:2.0:1788918572.622751:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788918572.622754:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd600, rc 0) 00000100:00100000:2.0:1788918572.622821:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+6:10147:x1875816855135488:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 359us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918572.622827:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00080000:1.0:1788918572.623358:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918572.631519:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918572.631684:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855135616 00000100:00100000:0.0:1788918572.631694:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855135616 00000100:00100000:0.0:1788918572.631757:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:0.0:1788918572.631766:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+6:10148:x1875816855135616:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788918572.631786:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918572.631805:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac8f58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f03b5 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.631904:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8f5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.631919:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.631932:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.631949:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac8f66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.631957:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac8f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.631965:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac8f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632302:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8f6d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632311:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8f6d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632319:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8f6d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918572.632355:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788918572.632359:0:11359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788918572.632380:0:11359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8f6d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632404:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632410:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8f5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632416:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8f5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632422:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918572.632427:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8f5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632435:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8f5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632448:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fffbdf3700) 00010000:00010000:0.0:1788918572.632451:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918572.632456:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8f5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632463:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac8f5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632477:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac8f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632484:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac8f66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632490:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac8f66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632503:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918572.632507:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac8f66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632514:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac8f66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632523:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff94fff681c000) 00010000:00010000:0.0:1788918572.632525:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918572.632528:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac8f66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632535:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac8f66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632581:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac8f58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03b5 expref: 8 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632594:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8f6d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03b5 expref: 7 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918572.632602:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94fff681c800) 00010000:00010000:0.0:1788918572.632605:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788918572.632607:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21200, rc 0) 00000100:00100000:0.0:1788918572.632669:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+7:10148:x1875816855135616:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 904us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918572.632676:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:0.0:1788918572.638287:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918572.638443:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855135872 00000100:00100000:2.0:1788918572.638453:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855135872 00000100:00100000:2.0:1788918572.638511:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:2.0:1788918572.638521:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+7:10148:x1875816855135872:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788918572.638540:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918572.638568:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac8f74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f03bc expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.638633:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8f7b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.638659:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8f7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.638670:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8f7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640310:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac8f82 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640338:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac8f82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640348:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac8f82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640454:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc000/0x2811b8b2b0ac8f89 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640462:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc000/0x2811b8b2b0ac8f89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640469:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc000/0x2811b8b2b0ac8f89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918572.640478:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788918572.640631:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8f7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640639:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8f7b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640646:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8f7b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640716:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dcc00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918572.640722:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8f7b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640731:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8f7b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640755:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94fff681c800) 00010000:00010000:2.0:1788918572.640758:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918572.640763:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8f7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640770:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8f7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640787:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac8f82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640794:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac8f82 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640800:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac8f82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640805:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918572.640819:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac8f82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640825:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac8f82 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.640832:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94fffbdf3c00) 00010000:00010000:2.0:1788918572.640834:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918572.642058:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac8f82 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.642068:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac8f82 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.642371:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac8f74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03bc expref: 10 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.642387:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc000/0x2811b8b2b0ac8f89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03bc expref: 9 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918572.642395:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94fffbdf3600) 00010000:00010000:2.0:1788918572.642398:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918572.642400:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dc000, rc 0) 00000100:00100000:2.0:1788918572.642472:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+9:10148:x1875816855135872:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 3951us (4193us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788918572.642482:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:1.0:1788918572.657591:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918572.657786:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855136000 00000100:00100000:2.0:1788918572.657797:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855136000 00000100:00100000:2.0:1788918572.657878:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:2.0:1788918572.657889:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+9:10148:x1875816855136000:12345-192.168.202.49@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788918572.658015:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+9:10148:x1875816855136000:12345-192.168.202.49@tcp:59:lhsmtool_posix.0 Request processed in 128us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918572.658064:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 35 00010000:00010000:1.0:1788918572.694286:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788918572.758896:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788918573.719653:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918574.678332:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865656320:0@lo:400:kworker.0 00000100:00100000:2.0:1788918574.678425:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918574.678541:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865656192:0@lo:400:kworker.0 00000100:00100000:3.0:1788918574.678617:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865656064:0@lo:400:kworker.0 00000100:00100000:0.0:1788918574.682911:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918574.683005:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865656704:0@lo:400:kworker.0 00000100:00100000:0.0:1788918574.683068:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918574.683103:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865656704 00000100:00100000:0.0:1788918574.683126:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865656704 00000100:00100000:0.0:1788918574.683186:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788918574.683196:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865656704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918574.683349:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865656704:12345-0@lo:400:kworker.0 Request processed in 154us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918574.683419:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788918574.683530:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865656704:0@lo:400:kworker.0 00000100:00100000:1.0:1788918574.683734:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865656320 00000100:00100000:1.0:1788918574.683739:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865656320 00000100:00100000:1.0:1788918574.683778:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865656192 00000100:00100000:1.0:1788918574.683781:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865656192 00000100:00100000:1.0:1788918574.683813:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788918574.683821:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865656320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918574.683863:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865656320:12345-0@lo:400:kworker.0 Request processed in 44us (5438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918574.683869:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788918574.683902:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788918574.683912:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865656192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918574.683945:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865656192:12345-0@lo:400:kworker.0 Request processed in 37us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918574.683950:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1788918574.683965:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788918574.683970:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788918574.684332:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865656192:0@lo:400:kworker.0 00000100:00100000:2.0:1788918574.684852:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865656320:0@lo:400:kworker.0 00000100:00100000:2.0:1788918574.684870:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865656832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918574.684903:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918574.684939:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788918574.684947:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865656448:0@lo:400:kworker.0 00000100:00100000:2.0:1788918574.684983:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918574.685039:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865656448 00000100:00100000:2.0:1788918574.685044:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865656448 00000100:00100000:2.0:1788918574.685081:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788918574.685088:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865656448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918574.685141:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865656448:12345-0@lo:400:kworker.0 Request processed in 53us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918574.685147:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1788918574.685179:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff77f480 x1875816865656448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788918590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918574.685190:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865656448:0@lo:400:kworker.0 00000100:00100000:1.0:1788918574.688145:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865656832 00000100:00100000:1.0:1788918574.688162:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865656832 00000100:00100000:1.0:1788918574.688263:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788918574.688274:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865656832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918574.688309:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918574.688408:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865656832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (3503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918574.688416:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788918574.688452:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918574.688496:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865656832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918574.689128:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918574.689217:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff77d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865656576:0@lo:400:kworker.0 00000100:00100000:3.0:1788918574.689254:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918574.689389:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865656576 00000100:00100000:1.0:1788918574.689395:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865656576 00000100:00100000:1.0:1788918574.689456:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788918574.689464:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865656576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918574.689508:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865656576:12345-0@lo:400:kworker.0 Request processed in 45us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918574.689515:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788918574.689544:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff77d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865656576:0@lo:400:kworker.0 00000100:00080000:2.0:1788918574.689750:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918574.692009:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865656064 00000100:00100000:0.0:1788918574.692055:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865656064 00000100:00100000:0.0:1788918574.692130:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788918574.692140:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865656064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918574.692618:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865656064:12345-0@lo:400:kworker.0 Request processed in 478us (3488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918574.692626:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788918574.692865:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865656064:0@lo:400:kworker.0 00010000:00010000:1.0:1788918574.742867:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918575.276881:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918575.276939:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918575.276966:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918575.277051:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855136256 00000100:00100000:2.0:1788918575.277064:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855136256 00000100:00100000:2.0:1788918575.277149:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855136384 00000100:00100000:2.0:1788918575.277153:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855136384 00000100:00100000:2.0:1788918575.277180:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 130 00000100:00100000:2.0:1788918575.277191:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+9:2351:x1875816855136256:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918575.277288:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+9:2351:x1875816855136256:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 99us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918575.277296:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 130 00000100:00100000:2.0:1788918575.277391:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 131 00000100:00100000:2.0:1788918575.277399:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855136384:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918575.277428:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855136384:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 30us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918575.277448:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 131 00000100:00100000:2.0:1788918575.277469:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855136128 00000100:00100000:2.0:1788918575.277474:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855136128 00000100:00100000:2.0:1788918575.277502:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 282 00000100:00100000:2.0:1788918575.277508:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855136128:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918575.277536:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855136128:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 29us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918575.277543:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 282 00000100:00080000:3.0:1788918575.279291:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918575.702243:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788918575.702267:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865656960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918575.702359:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918575.702479:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865656960 00000100:00100000:3.0:1788918575.702487:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865656960 00000100:00100000:3.0:1788918575.702537:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788918575.702546:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865656960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788918575.702579:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918575.702622:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865656960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918575.702629:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788918575.702669:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffc5371180 x1875816865656960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918575.702687:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865656960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788918575.766293:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918576.286601:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918576.286637:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855136512 00000100:00100000:3.0:1788918576.286646:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855136512 00000100:00100000:3.0:1788918576.286709:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:3.0:1788918576.286719:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+9:10191:x1875816855136512:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918576.286737:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918576.286757:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8f97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f03c3 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.286827:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8f9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.286844:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8f9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.286856:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8f9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.286881:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fa5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.286889:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.286895:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.286939:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8f9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.286947:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8f9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.286954:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8f9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.286960:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918576.286964:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8f9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.286972:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8f9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.286983:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fffbdf3700) 00010000:00010000:3.0:1788918576.286986:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918576.286990:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8f9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.286997:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8f9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.287015:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.287041:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fa5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.287047:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.287053:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918576.287056:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.287063:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fa5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.287070:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94fff4b4e600) 00010000:00010000:3.0:1788918576.287073:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918576.287076:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fa5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.287082:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fa5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.287112:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8f97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03c3 expref: 10 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.287122:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fffbdf3700) 00010000:00010000:3.0:1788918576.287125:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918576.287133:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8f97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03c3 expref: 10 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.287143:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5e00, rc 0) 00000100:00100000:3.0:1788918576.287314:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+9:10191:x1875816855136512:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 596us (719us total) trans 0 rc 301/301 00000100:00100000:3.0:1788918576.287322:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:2.0:1788918576.317916:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918576.317990:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855136768 00000100:00100000:3.0:1788918576.317999:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855136768 00000100:00100000:3.0:1788918576.318075:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00100000:3.0:1788918576.318097:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+9:10191:x1875816855136768:12345-192.168.202.49@tcp:36:lfs.0 00010000:00010000:3.0:1788918576.318154:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918576.318193:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac8f51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03ae expref: 9 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.318213:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fffbdf3700) 00010000:00010000:3.0:1788918576.318224:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918576.318282:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.318296:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.318308:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.318320:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fb3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.318327:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.318347:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918576.318809:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788918576.318820:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.318828:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.318835:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.318842:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918576.318846:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.318854:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.318864:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:3.0:1788918576.318867:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918576.318871:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.318877:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788918576.318891:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f20a8844 reply state 00000000f52cd6a5 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918576.318911:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788918576.319009:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+10:10191:x1875816855136768:12345-192.168.202.49@tcp:36:lfs.0 Request processed in 925us (1104us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788918576.319016:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 37 00010000:00010000:3.0:1788918576.325334:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.325352:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fb3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.325360:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.325367:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918576.325372:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.325380:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fb3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.325396:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94fff4b4e800) 00010000:00010000:3.0:1788918576.325399:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918576.325404:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fb3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.325411:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fb3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918576.430470:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918576.430544:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855136896 00000100:00100000:3.0:1788918576.430556:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855136896 00000100:00100000:3.0:1788918576.430686:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00100000:3.0:1788918576.430697:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+9:10199:x1875816855136896:12345-192.168.202.49@tcp:101:lctl.0 00010000:00010000:3.0:1788918576.430720:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918576.430741:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f03ca expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.430820:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.430844:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.430857:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918576.430897:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788918576.430901:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918576.430940:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.430963:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03ca expref: 11 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.430982:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03ca expref: 10 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.430991:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918576.430994:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788918576.430998:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5e00, rc 0) 00000100:00100000:3.0:1788918576.431108:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+10:10199:x1875816855136896:12345-192.168.202.49@tcp:101:lctl.0 Request processed in 413us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918576.431121:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00100000:0.0:1788918576.502544:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918576.502769:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855137024 00000100:00100000:3.0:1788918576.502789:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855137024 00000100:00100000:3.0:1788918576.502860:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:3.0:1788918576.502872:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+10:10204:x1875816855137024:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788918576.502893:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918576.502915:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f03d1 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.502979:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8fcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.502994:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503006:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503072:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac8fd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503081:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac8fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503088:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac8fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503163:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4200/0x2811b8b2b0ac8fdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503189:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4200/0x2811b8b2b0ac8fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503195:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4200/0x2811b8b2b0ac8fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918576.503232:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788918576.503237:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918576.503292:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4200/0x2811b8b2b0ac8fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503304:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503311:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8fcf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503317:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8fcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503323:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918576.503327:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8fcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503334:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8fcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503346:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918576.503350:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918576.503354:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8fcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503370:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac8fcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503386:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac8fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503393:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac8fd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503399:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac8fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503403:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918576.503406:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac8fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503413:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac8fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503421:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94fff4b4e600) 00010000:00010000:3.0:1788918576.503424:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918576.503427:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac8fd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503433:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac8fd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503464:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac8fc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03d1 expref: 12 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503477:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4200/0x2811b8b2b0ac8fdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03d1 expref: 11 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.503490:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:3.0:1788918576.503492:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788918576.503494:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4200, rc 0) 00000100:00100000:3.0:1788918576.503556:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+11:10204:x1875816855137024:12345-192.168.202.49@tcp:101:bash.0 Request processed in 687us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918576.503563:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:0.0:1788918576.507473:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918576.507585:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855137280 00000100:00100000:2.0:1788918576.507597:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855137280 00000100:00100000:2.0:1788918576.507675:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:2.0:1788918576.507686:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+11:10204:x1875816855137280:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788918576.507707:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918576.507728:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac8fe4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f03d8 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.507851:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac8feb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.507867:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac8feb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.507879:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac8feb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.507915:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac8ff2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.507938:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac8ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.507945:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac8ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788918576.508341:0:5924:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788918576.508478:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8ff9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.508487:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.508495:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.508524:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac8feb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.508531:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac8feb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.508539:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac8feb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.508546:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918576.508550:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac8feb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.508558:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac8feb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.508582:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:2.0:1788918576.508585:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918576.508590:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac8feb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.508597:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac8feb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788918576.508613:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000750477ac reply state 00000000f15e7881 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac8ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918576.508623:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788918576.508658:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac8fe4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03d8 expref: 14 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.508671:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03d8 expref: 13 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.508679:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:2.0:1788918576.508681:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918576.508683:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dcc00, rc 0) 00000100:00100000:2.0:1788918576.508753:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+14:10204:x1875816855137280:12345-192.168.202.49@tcp:101:bash.0 Request processed in 1070us (1289us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788918576.508761:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:2.0:1788918576.515237:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:3.0:1788918576.515385:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac8ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.515398:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac8ff2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.515405:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac8ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.515412:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918576.515417:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac8ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.515425:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac8ff2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.515442:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94fffbdf9700) 00010000:00010000:3.0:1788918576.515445:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918576.515449:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac8ff2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.515456:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac8ff2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918576.520184:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855137408 00000100:00100000:0.0:1788918576.520199:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855137408 00000100:00100000:0.0:1788918576.520254:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:0.0:1788918576.520264:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875816855137408:12345-192.168.202.49@tcp:8:bash.0 00010000:00080000:0.0:1788918576.520304:0:6909:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:0.0:1788918576.520350:0:6909:0:(genops.c:1385:class_connect()) connect: client 9b921db9-4859-438b-976e-b950f67eace4, cookie 0x2811b8b2b0ac9007 00002000:00100000:0.0:1788918576.520361:0:6909:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9b921db9-4859-438b-976e-b950f67eace4/ffff94ffc2c6c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788918576.520370:0:6909:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788918576.520557:0:6909:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788918576.520587:0:6909:0:(import.c:65:import_set_state_nolock()) ffff94ffc2c68000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788918576.520718:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2348:x1875816855137408:12345-192.168.202.49@tcp:8:bash.0 Request processed in 388us (5424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918576.520728:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:1.0:1788918576.534008:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918576.538426:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855137536 00000100:00100000:2.0:1788918576.538442:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855137536 00000100:00100000:2.0:1788918576.538589:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:2.0:1788918576.538600:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+6:0:x1875816855137536:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788918576.538633:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918576.538657:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac900e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f03df expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788918576.538681:0:6911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918576.538699:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=278s v=(0 0) 00010000:00010000:2.0:1788918576.538704:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918576.538714:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac900e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03df expref: 7 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.538735:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac900e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03df expref: 7 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.538749:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48ddc00, rc 0) 00000100:00100000:2.0:1788918576.538848:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+7:0:x1875816855137536:12345-192.168.202.49@tcp:101:bash.0 Request processed in 249us (4850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918576.538855:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00080000:3.0:1788918576.539389:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918576.546151:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918576.546304:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855137664 00000100:00100000:0.0:1788918576.546315:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855137664 00000100:00100000:0.0:1788918576.546376:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:0.0:1788918576.546385:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+7:10204:x1875816855137664:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788918576.546403:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918576.546423:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f03e6 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.546453:0:6909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac900e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03df expref: 8 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.546462:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918576.546467:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918576.546472:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 8 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.546503:0:6909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac900e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03df expref: 8 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.546539:0:6909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac900e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03df expref: 8 pid: 6911 timeout: 378 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918576.546554:0:6909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6909:1875816865657088:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918576.546788:0:6909:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788918576.549413:0:6909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6909:1875816865657088:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918576.549448:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 8 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.549468:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21600, rc 0) 00000100:00100000:0.0:1788918576.549525:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+8:10204:x1875816855137664:12345-192.168.202.49@tcp:101:bash.0 Request processed in 3140us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918576.549534:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:1.0:1788918576.551241:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918576.551317:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855137792 00000100:00100000:3.0:1788918576.551326:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855137792 00010000:00010000:3.0:1788918576.551361:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac900e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03df expref: 8 pid: 6911 timeout: 378 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918576.551402:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:3.0:1788918576.551411:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+8:2349:x1875816855137792:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918576.551426:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918576.551447:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac900e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03df expref: 8 pid: 6911 timeout: 378 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.551462:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac900e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03df expref: 8 pid: 6911 timeout: 378 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.551488:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac900e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03df expref: 8 pid: 6911 timeout: 378 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.551508:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918576.551513:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918576.551522:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.551532:0:5909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.551585:0:5909:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918576.551598:0:5909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5373480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5909:1875816865657216:192.168.202.49@tcp:105: 00000100:00100000:3.0:1788918576.551666:0:5909:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6b5bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788918576.555207:0:5909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5373480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5909:1875816865657216:192.168.202.49@tcp:105: 00010000:00010000:3.0:1788918576.555231:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918576.555286:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855137792:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 3875us (4051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918576.555297:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:1.0:1788918576.557197:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918576.557279:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855138048 00000100:00100000:2.0:1788918576.557288:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855138048 00000100:00100000:2.0:1788918576.557341:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:2.0:1788918576.557350:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+13:10204:x1875816855138048:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:2.0:1788918576.557605:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+14:10204:x1875816855138048:12345-192.168.202.49@tcp:35:bash.0 Request processed in 255us (424us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788918576.557621:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:1.0:1788918576.637954:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918576.638064:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855138304 00000100:00100000:2.0:1788918576.638080:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855138304 00000100:00100000:2.0:1788918576.638133:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:2.0:1788918576.638142:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+14:10215:x1875816855138304:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788918576.638167:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918576.638199:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac901c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f03ed expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918576.638302:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788918576.638398:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac901c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03ed expref: 16 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.638413:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:2.0:1788918576.638416:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788918576.638421:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac901c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03ed expref: 16 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.638435:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dc800, rc 0) 00000100:00100000:2.0:1788918576.638493:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+15:10215:x1875816855138304:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 352us (547us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788918576.638500:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:0.0:1788918576.642263:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918576.642410:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855138560 00000100:00100000:2.0:1788918576.642420:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855138560 00000100:00100000:2.0:1788918576.642473:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:2.0:1788918576.642483:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+15:10215:x1875816855138560:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:2.0:1788918576.642706:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+16:10215:x1875816855138560:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 223us (452us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788918576.642714:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:1.0:1788918576.696452:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918576.696521:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855138688 00000100:00100000:2.0:1788918576.696532:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855138688 00000100:00100000:2.0:1788918576.696597:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:2.0:1788918576.696607:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefedaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+16:10221:x1875816855138688:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788918576.696630:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918576.696651:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac902a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f03f4 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.696869:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.696883:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.696895:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918576.696935:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788918576.696938:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918576.697066:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.697095:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac902a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03f4 expref: 18 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.697116:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03f4 expref: 17 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.697124:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:2.0:1788918576.697127:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788918576.697151:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd000, rc 0) 00000100:00100000:2.0:1788918576.697212:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefedaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+17:10221:x1875816855138688:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 607us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918576.697220:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:3.0:1788918576.701913:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918576.702086:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855138944 00000100:00100000:2.0:1788918576.702096:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855138944 00000100:00100000:2.0:1788918576.702146:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:2.0:1788918576.702153:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+17:10221:x1875816855138944:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788918576.702170:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918576.702186:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9038 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f03fb expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.702271:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac903f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.702284:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac903f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.702308:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac903f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918576.702322:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788918576.702439:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9038 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03fb expref: 20 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.702460:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac903f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03fb expref: 19 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.702469:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:2.0:1788918576.702486:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918576.702490:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48ddc00, rc 0) 00000100:00100000:2.0:1788918576.702552:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+19:10221:x1875816855138944:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 398us (651us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788918576.702559:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:0.0:1788918576.705203:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918576.705243:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918576.705532:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855139200 00000100:00100000:3.0:1788918576.705543:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855139200 00000100:00100000:3.0:1788918576.705604:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:3.0:1788918576.705623:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+19:10221:x1875816855139200:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918576.705652:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918576.705670:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac904d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0402 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.705787:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9054 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.705802:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.705815:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918576.706014:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788918576.706201:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac904d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0402 expref: 22 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.706221:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0402 expref: 21 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.706231:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:3.0:1788918576.706234:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788918576.706237:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5800, rc 0) 00000100:00100000:2.0:1788918576.706379:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855139328 00000100:00100000:2.0:1788918576.706384:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855139328 00000100:00100000:2.0:1788918576.706423:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:2.0:1788918576.706430:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+22:2352:x1875816855139328:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918576.706440:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918576.706454:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac903f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03fb expref: 22 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.706465:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:2.0:1788918576.706469:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918576.706508:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+21:10221:x1875816855139200:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 895us (1324us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788918576.706516:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:2.0:1788918576.710482:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+20:2352:x1875816855139328:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 4040us (5225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918576.710498:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:1.0:1788918576.733524:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918576.733634:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855139456 00000100:00100000:0.0:1788918576.733644:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855139456 00000100:00100000:0.0:1788918576.733699:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:0.0:1788918576.733709:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855139456:12345-192.168.202.49@tcp:1:lfs.0 00010000:00010000:0.0:1788918576.733749:0:7258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.733783:0:7258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.733802:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788918576.733806:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788918576.733811:0:7258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.733854:0:7258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.733869:0:7258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 7 pid: 6909 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918576.734150:0:7258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7258:1875816865657344:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918576.734561:0:7258:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8de9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788918576.746629:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918576.747246:0:7258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7258:1875816865657344:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918576.747276:0:7258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918576.747439:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855139584 00000100:00100000:1.0:1788918576.747446:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855139584 00002000:00100000:1.0:1788918576.747521:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff94ffefd1ad80 x1875816855139584/t0(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:447/0 lens 504/0 e 0 to 0 dl 1788918587 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788918576.747532:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffefd1ad80 with x1875816855139584 ext(0->12) 00010000:00010000:1.0:1788918576.747539:0:6915:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 8 pid: 6909 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918576.747555:0:6915:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 8 pid: 6909 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788918576.747563:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94ffefd1ad80 00000100:00100000:1.0:1788918576.747597:0:6915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:1.0:1788918576.747607:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b921db9-4859-438b-976e-b950f67eace4+8:2350:x1875816855139584:12345-192.168.202.49@tcp:4:lfs.0 00000001:00100000:0.0:1788918576.751376:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00000100:00100000:1.0:1788918576.752437:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b921db9-4859-438b-976e-b950f67eace4+9:2350:x1875816855139584:12345-192.168.202.49@tcp:4:lfs.0 Request processed in 4825us (5817us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788918576.752451:0:6915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00002000:00100000:1.0:1788918576.752479:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff94ffefd1ad80 x1875816855139584/t4294967299(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:447/0 lens 504/448 e 0 to 0 dl 1788918587 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788918576.752490:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffefd1ad80 with x1875816855139584 ext(0->12) 00010000:00010000:1.0:1788918576.752501:0:6915:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 9 pid: 6909 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918576.752519:0:6915:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 9 pid: 6909 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788918576.752528:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94ffefd1ad80 00000100:00100000:1.0:1788918576.762120:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918576.763876:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855139712 00000100:00100000:2.0:1788918576.763899:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855139712 00010000:00010000:2.0:1788918576.763952:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 9 pid: 6909 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918576.764166:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:2.0:1788918576.764178:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefeda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+9:2351:x1875816855139712:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918576.764193:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788918576.764213:0:7989:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788918576.764216:0:7989:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788918575 00002000:00010000:2.0:1788918576.764219:0:7989:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788918575 00002000:00010000:2.0:1788918576.764221:0:7989:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788918575 00002000:00010000:2.0:1788918576.764223:0:7989:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788918576.764230:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 9 pid: 6909 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.764244:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 9 pid: 6909 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.764268:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000338a0989/0x2811b8b2b0ac9015 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03e6 expref: 9 pid: 6909 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.764286:0:7989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788918576.764291:0:7989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788918576.764955:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.764968:0:7989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.765015:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918576.765206:0:7258:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.765217:0:7258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.765239:0:7258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.765248:0:7258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.765264:0:7258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.765272:0:7258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20c00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918576.765277:0:7258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.765287:0:7258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.765314:0:7258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918576.765322:0:7258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9062 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918576.768982:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefeda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+8:2351:x1875816855139712:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 4794us (6860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918576.768998:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:0.0:1788918576.773749:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855139456:12345-192.168.202.49@tcp:1:lfs.0 Request processed in 40029us (40221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918576.773764:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:2.0:1788918576.786097:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918576.786224:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855139968 00000100:00100000:3.0:1788918576.786235:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855139968 00000100:00100000:3.0:1788918576.786290:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:3.0:1788918576.786307:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+20:10221:x1875816855139968:12345-192.168.202.49@tcp:35:lfs.0 00000004:00010000:3.0:1788918576.786366:0:5927:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0402 expref: 20 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788918576.786584:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788918576.786642:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788918576.787230:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788918576.787264:0:5927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.787279:0:5927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8ff9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03d8 expref: 24 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.787354:0:5927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.787393:0:5927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03d8 expref: 24 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.787410:0:5927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03d8 expref: 24 pid: 5924 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918576.787425:0:5927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5372d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5927:1875816865657472:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918576.787555:0:5927:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6b5b3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788918576.791076:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918576.795337:0:5927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5372d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5927:1875816865657472:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918576.795366:0:5927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918576.797221:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918576.797546:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855140096 00000100:00100000:3.0:1788918576.797557:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855140096 00010000:00010000:3.0:1788918576.797593:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03d8 expref: 25 pid: 5924 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918576.797647:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00100000:3.0:1788918576.797656:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+25:2349:x1875816855140096:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918576.797671:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918576.797678:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03d8 expref: 25 pid: 5924 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.797691:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03d8 expref: 25 pid: 5924 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.797715:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac8ff9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f03d8 expref: 25 pid: 5924 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.797752:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:3.0:1788918576.797758:0:5909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.797768:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.798495:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.798641:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918576.798707:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+24:2349:x1875816855140096:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 1049us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918576.798716:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 37 00010000:00010000:2.0:1788918576.801470:0:5927:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918576.801488:0:5927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788918576.801602:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788918576.801840:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788918576.801933:0:5927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe17480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5927:1875816865657600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788918576.801991:0:5927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918576.802349:0:5927:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68a7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788918576.802605:0:5929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865657600 00000100:00100000:3.0:1788918576.802614:0:5929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865657600 00000100:00100000:3.0:1788918576.802687:0:5929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788918576.802697:0:5929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5927:x1875816865657600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788918576.802820:0:5929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5927:x1875816865657600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 124us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918576.802828:0:5929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788918576.803038:0:5927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe17480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5927:1875816865657600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788918576.803348:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788918576.803413:0:5927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefed9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5927:1875816865657728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788918576.803452:0:5927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788918576.803552:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918576.803600:0:5927:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd05af240 going to sleep for 11 seconds 00000100:00100000:3.0:1788918576.805269:0:5929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865657728 00000100:00100000:3.0:1788918576.805282:0:5929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865657728 00000100:00100000:3.0:1788918576.805336:0:5929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788918576.805346:0:5929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5927:x1875816865657728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788918576.805547:0:5929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5927:x1875816865657728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 201us (2093us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788918576.805574:0:5929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788918576.805600:0:5927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefed9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5927:1875816865657728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788918576.805799:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788918576.805840:0:5927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918576.805851:0:5927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918576.805859:0:5927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918576.805865:0:5927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918576.805875:0:5927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918576.805884:0:5927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918576.805900:0:5927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:1.0:1788918576.805903:0:5927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788918576.805907:0:5927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918576.805914:0:5927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9069 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788918576.806008:0:5927:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788918576.806115:0:5927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788918576.806126:0:5927:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 279087105199ns, next at 280087103321ns, rc = 0 00000001:00080000:1.0:1788918576.806132:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788918576.806151:0:5927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:1.0:1788918576.806154:0:5927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788918576.806162:0:5927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9054 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0402 expref: 28 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918576.806269:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+27:10221:x1875816855139968:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 19963us (20179us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788918576.806277:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000020:00080000:1.0:1788918576.806281:0:5927:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788918576.814292:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918576.814583:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855140224 00000100:00100000:3.0:1788918576.814594:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855140224 00000100:00100000:3.0:1788918576.814726:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:3.0:1788918576.814738:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+27:10221:x1875816855140224:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918576.814762:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918576.814796:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac9070 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0409 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.815694:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac9070 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0409 expref: 28 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.815716:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac9070 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0409 expref: 28 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.815736:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:3.0:1788918576.815739:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788918576.815743:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4a00, rc 0) 00000100:00100000:3.0:1788918576.815825:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+28:10221:x1875816855140224:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1088us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918576.816173:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:3.0:1788918576.819788:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918576.820781:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855140480 00000100:00100000:1.0:1788918576.820793:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855140480 00000100:00100000:1.0:1788918576.820869:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:1.0:1788918576.820882:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc719a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+28:10221:x1875816855140480:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:1.0:1788918576.822306:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc719a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+29:10221:x1875816855140480:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 1411us (2523us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788918576.822318:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:1.0:1788918576.915305:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918576.915444:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855140736 00000100:00100000:3.0:1788918576.915456:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855140736 00000100:00100000:3.0:1788918576.915515:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:3.0:1788918576.915526:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefedbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+29:10231:x1875816855140736:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918576.915569:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918576.915590:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0410 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918576.915693:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788918576.915797:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9077 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0410 expref: 31 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.915813:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918576.915816:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788918576.915821:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0410 expref: 31 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.915837:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5a00, rc 0) 00000100:00100000:3.0:1788918576.916107:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefedbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+30:10231:x1875816855140736:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 582us (813us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788918576.916115:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:2.0:1788918576.932359:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918576.933695:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855140864 00000100:00100000:3.0:1788918576.933707:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855140864 00000100:00100000:3.0:1788918576.933872:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:3.0:1788918576.933990:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+30:10231:x1875816855140864:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:3.0:1788918576.934082:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9085 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934100:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9085 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934113:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9085 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934145:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac908c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934153:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac908c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934160:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac908c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934302:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9093 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934311:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934319:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788918576.934369:0:11359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934384:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9085 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934392:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9085 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934399:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9085 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934405:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918576.934409:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9085 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934423:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9085 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934436:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:3.0:1788918576.934439:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918576.934444:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9085 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934451:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9085 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934464:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac908c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934471:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac908c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934477:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac908c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934482:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918576.934485:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac908c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934491:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac908c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934497:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94fff4b4ef00) 00010000:00010000:3.0:1788918576.934500:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918576.934502:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac908c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934517:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac908c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934531:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934537:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9093 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934543:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934549:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918576.934551:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934571:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9093 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934578:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:3.0:1788918576.934581:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918576.934584:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9093 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918576.934589:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9093 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918576.935077:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+30:10231:x1875816855140864:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 1193us (2725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918576.935086:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:1.0:1788918576.939858:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918576.939921:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855141120 00000100:00100000:2.0:1788918576.939932:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855141120 00000100:00100000:2.0:1788918576.940963:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:2.0:1788918576.940977:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+30:10231:x1875816855141120:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:2.0:1788918576.941330:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+31:10231:x1875816855141120:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 354us (1565us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788918576.941339:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788918577.021293:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918577.021467:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855141376 00000100:00100000:0.0:1788918577.021477:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855141376 00000100:00100000:0.0:1788918577.021558:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:0.0:1788918577.021570:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefedb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+31:10234:x1875816855141376:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918577.021595:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918577.021630:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac909a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0417 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.021717:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac90a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.021733:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac90a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.021753:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac90a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.021776:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.021784:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.021792:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.021914:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac90af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.021923:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac90af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.021931:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac90af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918577.021940:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788918577.022012:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac90a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022075:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac90a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022083:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac90a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022090:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918577.022094:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac90a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022103:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac90a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022116:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:0.0:1788918577.022119:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918577.022124:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac90a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022131:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac90a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022146:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022152:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022158:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022163:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918577.022171:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022188:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022196:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94fff6819200) 00010000:00010000:0.0:1788918577.022198:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918577.022202:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022208:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022251:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac909a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0417 expref: 34 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022265:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac90af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0417 expref: 33 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.022273:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:0.0:1788918577.022275:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788918577.022278:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21600, rc 0) 00000100:00100000:0.0:1788918577.022328:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefedb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+33:10234:x1875816855141376:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 762us (1044us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788918577.022336:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:1.0:1788918577.025642:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918577.025740:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855141504 00000100:00100000:3.0:1788918577.025750:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855141504 00000100:00100000:3.0:1788918577.025817:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:3.0:1788918577.025826:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+33:10234:x1875816855141504:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:3.0:1788918577.025898:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac90bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.025914:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac90bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.025926:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac90bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.025957:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac90bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.025964:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac90bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.025971:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac90bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.025977:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918577.025981:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac90bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.025989:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac90bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.026000:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:3.0:1788918577.026003:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788918577.026007:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac90bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.026076:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac90bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918577.026141:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+33:10234:x1875816855141504:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 315us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918577.026149:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00080000:2.0:1788918577.027011:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918577.040669:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918577.040798:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855141760 00000100:00100000:3.0:1788918577.040807:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855141760 00000100:00100000:3.0:1788918577.040855:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:3.0:1788918577.040864:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefeda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+33:10234:x1875816855141760:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788918577.041150:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefeda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+34:10234:x1875816855141760:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 286us (501us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788918577.041159:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:1.0:1788918577.512909:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918577.513305:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855142016 00000100:00100000:0.0:1788918577.513315:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855142016 00000100:00100000:0.0:1788918577.513376:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:0.0:1788918577.513385:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefedb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+34:10265:x1875816855142016:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:0.0:1788918577.513422:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918577.513442:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac90c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f041e expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.513541:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.513557:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.513569:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918577.513579:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788918577.513808:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac90c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f041e expref: 37 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.513828:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f041e expref: 36 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.513838:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:0.0:1788918577.513840:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788918577.513844:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20600, rc 0) 00000100:00100000:0.0:1788918577.513908:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefedb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+36:10265:x1875816855142016:12345-192.168.202.49@tcp:101:cat.0 Request processed in 524us (1007us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788918577.513920:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:1.0:1788918577.518740:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918577.518801:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918577.518844:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855142272 00000100:00100000:3.0:1788918577.518855:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855142272 00000100:00100000:2.0:1788918577.518877:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855142400 00000100:00100000:2.0:1788918577.518884:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855142400 00000100:00100000:3.0:1788918577.518919:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:3.0:1788918577.518930:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+37:10265:x1875816855142272:12345-192.168.202.49@tcp:35:cat.0 00000100:00100000:2.0:1788918577.518991:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:2.0:1788918577.519001:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5096450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+37:2349:x1875816855142400:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918577.519014:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918577.519073:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac90cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f041e expref: 37 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918577.519092:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:2.0:1788918577.519098:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918577.519194:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5096450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+36:2349:x1875816855142400:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 195us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918577.519202:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:2.0:1788918577.520821:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+36:10265:x1875816855142272:12345-192.168.202.49@tcp:35:cat.0 Request processed in 1887us (2085us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788918577.520832:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:1.0:1788918577.706686:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918577.706987:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855142656 00000100:00100000:3.0:1788918577.706999:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855142656 00000100:00100000:3.0:1788918577.707123:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:3.0:1788918577.707136:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+36:10271:x1875816855142656:12345-192.168.202.49@tcp:101:dd.0 00010000:00010000:3.0:1788918577.707170:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918577.707174:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788918577.707209:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9031 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03f4 expref: 36 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.707256:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:3.0:1788918577.707262:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918577.707294:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac90d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0425 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.707426:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.707440:0:5926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac90af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0417 expref: 36 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.707448:0:5926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.707485:0:5926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac90af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0417 expref: 36 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.707499:0:5926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac90af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0417 expref: 36 pid: 5924 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918577.707515:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5372d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865657856:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918577.707640:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6b5b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918577.718809:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5372d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865657856:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918577.718847:0:5926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918577.728967:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918577.729651:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855142784 00000100:00100000:2.0:1788918577.729662:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855142784 00010000:00010000:2.0:1788918577.729706:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac90af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0417 expref: 37 pid: 5924 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918577.729870:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00100000:2.0:1788918577.729881:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+37:2349:x1875816855142784:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918577.729898:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918577.729906:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac90af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0417 expref: 37 pid: 5924 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918577.729921:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac90af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0417 expref: 37 pid: 5924 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918577.729945:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac90af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0417 expref: 37 pid: 5924 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918577.729964:0:7989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:2.0:1788918577.729970:0:7989:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918577.729980:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918577.729988:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918577.730054:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918577.730106:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+36:2349:x1875816855142784:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 227us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918577.730114:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 38 00010000:00010000:0.0:1788918577.730169:0:5926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.730197:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918577.730214:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788918577.730401:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac90d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0425 expref: 37 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.730418:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0425 expref: 36 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.730425:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:0.0:1788918577.730428:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788918577.730430:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4800, rc 0) 00000100:00100000:0.0:1788918577.730457:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+36:10271:x1875816855142656:12345-192.168.202.49@tcp:101:dd.0 Request processed in 23325us (23779us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788918577.730464:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 51 00000001:00080000:0.0:1788918577.732902:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967333 is committed 00000004:00080000:0.0:1788918577.732927:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788918577.733317:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865657984:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788918577.733409:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788918577.733585:0:5903:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94ffe9846480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788918577.733591:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94ffc3547b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94ffe9846c00 00000020:00080000:0.0:1788918577.733594:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94ffc3547300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94ffefc4ba00 00000100:00100000:3.0:1788918577.733704:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865657984 00000100:00100000:3.0:1788918577.733718:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865657984 00000100:00100000:3.0:1788918577.733773:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788918577.733783:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3419:x1875816865657984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788918577.733809:0:6911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788918577.733841:0:6911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa0bb2f, atime: 0x6aa0bb2f, ctime: 0x6aa0bb2f, blocks: 0x8 00010000:00010000:3.0:1788918577.733849:0:6911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf8af446/0x2811b8b2b0ac90ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.733863:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=280s v=(0 0) 00010000:00010000:3.0:1788918577.733867:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918577.733874:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf8af446/0x2811b8b2b0ac90ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.733890:0:6911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf8af446/0x2811b8b2b0ac90ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.733901:0:6911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf8af446/0x2811b8b2b0ac90ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.733909:0:6911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf8af446/0x2811b8b2b0ac90ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.733930:0:6911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788918577.734090:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3419:x1875816865657984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 308us (680us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788918577.734098:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788918577.734117:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918577.734127:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf8af446/0x2811b8b2b0ac90ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.734134:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5a00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918577.734137:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf8af446/0x2811b8b2b0ac90ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.734144:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf8af446/0x2811b8b2b0ac90ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.734155:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf8af446/0x2811b8b2b0ac90ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.734159:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf8af446/0x2811b8b2b0ac90ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.737625:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918577.737631:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918577.737634:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788918577.737840:0:3419:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94ffc5372d80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788918577.737851:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865657984:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788918577.737952:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000020:00080000:2.0:1788918577.738039:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788918577.738204:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788918577.738352:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855142912 00000100:00100000:3.0:1788918577.738359:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855142912 00000100:00100000:3.0:1788918577.738404:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:3.0:1788918577.738410:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+11:10271:x1875816855142912:12345-192.168.202.49@tcp:101:dd.0 00010000:00010000:3.0:1788918577.738429:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918577.738444:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac90f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f042c expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.738478:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac90fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.738490:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac90fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.738499:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac90fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.738597:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac90f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f042c expref: 13 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.738610:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac90fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f042c expref: 12 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.738619:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:3.0:1788918577.738622:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788918577.738626:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5800, rc 0) 00000100:00100000:3.0:1788918577.738709:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+12:10271:x1875816855142912:12345-192.168.202.49@tcp:101:dd.0 Request processed in 299us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918577.738714:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:1.0:1788918577.760331:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918577.760454:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855143168 00000100:00100000:0.0:1788918577.760467:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855143168 00000100:00100000:0.0:1788918577.760541:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:0.0:1788918577.760551:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefedb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+12:10271:x1875816855143168:12345-192.168.202.49@tcp:36:dd.0 00010000:00010000:0.0:1788918577.760827:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9103 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.760850:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9103 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918577.760863:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9103 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788918577.760910:0:11359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788918577.760935:0:11359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a26fb3e reply state 000000000d377e4a transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9103 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918577.760944:0:11359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788918577.761090:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefedb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+15:10271:x1875816855143168:12345-192.168.202.49@tcp:36:dd.0 Request processed in 539us (770us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788918577.761097:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 53 00000020:00080000:0.0:1788918577.761103:0:11359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788918577.765709:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9103 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.765728:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9103 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.765735:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9103 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.765756:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918577.765769:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9103 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.765778:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9103 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.765794:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:3.0:1788918577.765797:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918577.765802:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9103 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918577.765808:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9103 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918577.814248:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918578.114501:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918578.114601:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855143296 00000100:00100000:3.0:1788918578.114613:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855143296 00000100:00100000:3.0:1788918578.114682:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 54 00000100:00100000:3.0:1788918578.114692:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+14:10285:x1875816855143296:12345-192.168.202.49@tcp:101:stat.0 00010000:00010000:3.0:1788918578.114716:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918578.114736:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac910a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0433 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.114833:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9111 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.114849:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.114862:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.114892:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9118 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.114899:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.114906:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.114978:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac911f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.114989:0:5924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0425 expref: 15 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.114998:0:5924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac911f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.115083:0:5924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0425 expref: 15 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.115099:0:5924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0425 expref: 15 pid: 5926 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918578.115114:0:5924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865658112:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918578.116575:0:5924:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6b5b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918578.119812:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918578.122932:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855143552 00000100:00100000:1.0:1788918578.122955:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855143552 00000100:00100000:1.0:1788918578.123088:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:1.0:1788918578.123100:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+16:5432:x1875816855143552:12345-192.168.202.49@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788918578.123472:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+17:5432:x1875816855143552:12345-192.168.202.49@tcp:35:ldlm_bl.0 Request processed in 374us (3669us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788918578.123481:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:3.0:1788918578.127171:0:5924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865658112:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918578.127201:0:5924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac911f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918578.131330:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918578.135288:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855143680 00000100:00100000:3.0:1788918578.135320:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855143680 00010000:00010000:3.0:1788918578.135381:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0425 expref: 17 pid: 5926 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918578.135442:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:3.0:1788918578.135454:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+17:2349:x1875816855143680:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918578.135474:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918578.135483:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0425 expref: 17 pid: 5926 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.135503:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0425 expref: 17 pid: 5926 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.135534:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac90e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0425 expref: 17 pid: 5926 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.135560:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:3.0:1788918578.135566:0:5909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac911f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.135578:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac911f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.135588:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac911f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.135644:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918578.135770:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+16:2349:x1875816855143680:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 309us (4440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918578.135779:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 39 00010000:00010000:1.0:1788918578.136365:0:5924:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac911f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136375:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac911f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918578.136439:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788918578.136444:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788918578.136482:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac911f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136497:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac911f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136507:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136514:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9111 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136520:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136526:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918578.136530:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136538:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9111 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136549:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:1.0:1788918578.136552:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918578.136556:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9111 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136562:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9111 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136587:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136593:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9118 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136599:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136606:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918578.136609:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136615:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9118 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136623:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94fff4b4ef00) 00010000:00010000:1.0:1788918578.136625:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918578.136628:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9118 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136634:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136673:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac910a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0433 expref: 16 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136687:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac911f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0433 expref: 15 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.136706:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:1.0:1788918578.136708:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788918578.136711:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5600, rc 0) 00000100:00100000:1.0:1788918578.136899:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+15:10285:x1875816855143296:12345-192.168.202.49@tcp:101:stat.0 Request processed in 22069us (22268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918578.136928:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 54 00000100:00100000:1.0:1788918578.253400:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918578.253669:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855143936 00000100:00100000:0.0:1788918578.253679:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855143936 00000100:00100000:0.0:1788918578.253790:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:0.0:1788918578.253802:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefeda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+15:10291:x1875816855143936:12345-192.168.202.49@tcp:36:truncate.0 00010000:00010000:0.0:1788918578.253868:0:11359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918578.253961:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac911f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0433 expref: 15 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.253985:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:0.0:1788918578.253990:0:11359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918578.254729:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9126 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.254747:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.254771:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788918578.254815:0:11359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788918578.254838:0:11359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b2eb15a reply state 00000000f5fbb2b7 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918578.254847:0:11359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788918578.254986:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefeda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+17:10291:x1875816855143936:12345-192.168.202.49@tcp:36:truncate.0 Request processed in 1185us (1597us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788918578.254994:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 55 00000020:00080000:0.0:1788918578.254999:0:11359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788918578.258618:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.258637:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9126 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.258644:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9126 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.258650:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918578.258655:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9126 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.258662:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9126 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.258679:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:3.0:1788918578.258682:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918578.258686:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9126 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.258692:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9126 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918578.347781:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918578.347881:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855144064 00000100:00100000:2.0:1788918578.347890:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855144064 00000100:00100000:2.0:1788918578.347964:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00100000:2.0:1788918578.347975:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+16:10305:x1875816855144064:12345-192.168.202.49@tcp:101:stat.0 00010000:00010000:2.0:1788918578.347998:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918578.348060:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac912d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f043a expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348127:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9134 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348142:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9134 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348153:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9134 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348168:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac913b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348175:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac913b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348181:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac913b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348303:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9142 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348327:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348334:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918578.348376:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788918578.348380:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918578.348400:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348412:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348421:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9134 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348427:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9134 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348434:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9134 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348439:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918578.348443:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9134 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348450:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9134 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348462:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:2.0:1788918578.348471:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918578.348476:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9134 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348483:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9134 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348497:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac913b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348503:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac913b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348508:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac913b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348513:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dca00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918578.348516:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac913b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348521:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac913b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348528:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94ffff5d1300) 00010000:00010000:2.0:1788918578.348530:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918578.348533:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac913b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348538:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac913b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348570:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac912d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f043a expref: 18 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348596:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f043a expref: 17 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.348603:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:2.0:1788918578.348606:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918578.348608:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd600, rc 0) 00000100:00100000:2.0:1788918578.348678:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+17:10305:x1875816855144064:12345-192.168.202.49@tcp:101:stat.0 Request processed in 704us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918578.348685:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00100000:2.0:1788918578.475167:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918578.480138:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855144320 00000100:00100000:0.0:1788918578.480155:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855144320 00000100:00100000:0.0:1788918578.480549:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:0.0:1788918578.480562:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+17:10314:x1875816855144320:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918578.480584:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918578.480606:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0441 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918578.482104:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788918578.482221:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9149 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0441 expref: 19 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.482258:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:0.0:1788918578.482261:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788918578.482846:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0441 expref: 19 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.482869:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21c00, rc 0) 00000100:00100000:0.0:1788918578.485067:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+18:10314:x1875816855144320:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 4493us (9894us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788918578.485082:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:3.0:1788918578.496500:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918578.496663:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855144576 00000100:00100000:1.0:1788918578.496675:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855144576 00000100:00100000:1.0:1788918578.496737:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:1.0:1788918578.496747:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+18:10314:x1875816855144576:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:1.0:1788918578.496994:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+19:10314:x1875816855144576:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 246us (502us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788918578.497001:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:2.0:1788918578.637213:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918578.637336:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855144832 00000100:00100000:3.0:1788918578.637419:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855144832 00000100:00100000:3.0:1788918578.637878:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:3.0:1788918578.637893:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+19:10321:x1875816855144832:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788918578.637949:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918578.637980:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac9157 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0448 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.638215:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.638235:0:5925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9142 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f043a expref: 20 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.638245:0:5925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.638289:0:5925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f043a expref: 20 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.638306:0:5925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9142 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f043a expref: 20 pid: 5925 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918578.638324:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865658240:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918578.638703:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6b5b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918578.651101:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865658240:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918578.651142:0:5925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918578.651299:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918578.651445:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855144960 00000100:00100000:0.0:1788918578.651455:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855144960 00010000:00010000:0.0:1788918578.651509:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9142 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f043a expref: 21 pid: 5925 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918578.651555:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:0.0:1788918578.651566:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+21:2349:x1875816855144960:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918578.651586:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918578.651604:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9142 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f043a expref: 21 pid: 5925 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.651619:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f043a expref: 21 pid: 5925 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.651645:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9142 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f043a expref: 21 pid: 5925 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.651684:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:0.0:1788918578.651689:0:5911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.651700:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.651708:0:5911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.651743:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918578.651821:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+20:2349:x1875816855144960:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 256us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918578.651829:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 40 00010000:00010000:2.0:1788918578.652045:0:5925:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.652053:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918578.652076:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788918578.652252:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac9157 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0448 expref: 21 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.652271:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0448 expref: 20 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.652278:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:2.0:1788918578.652281:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788918578.652291:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5600, rc 0) 00000100:00100000:2.0:1788918578.652320:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+20:10321:x1875816855144832:12345-192.168.202.49@tcp:101:bash.0 Request processed in 14431us (15116us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788918578.652328:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:2.0:1788918578.656065:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918578.656148:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855145216 00000100:00100000:0.0:1788918578.656323:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855145216 00000100:00100000:0.0:1788918578.656511:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:0.0:1788918578.656524:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+20:10321:x1875816855145216:12345-192.168.202.49@tcp:36:bash.0 00010000:00010000:0.0:1788918578.657683:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac916c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.657713:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac916c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.657729:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac916c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788918578.657812:0:5926:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788918578.657850:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b7bf22c reply state 00000000b9bffe35 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac916c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918578.657894:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788918578.658068:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+23:10321:x1875816855145216:12345-192.168.202.49@tcp:36:bash.0 Request processed in 1542us (2011us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788918578.658078:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 59 00000020:00080000:0.0:1788918578.658085:0:5926:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788918578.662500:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac916c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.662524:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac916c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.662552:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac916c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.662559:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918578.662565:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac916c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.662575:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac916c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.662597:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:3.0:1788918578.662610:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918578.662616:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac916c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918578.662622:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac916c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918578.668711:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918578.668937:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855145344 00000100:00100000:1.0:1788918578.668951:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855145344 00000100:00100000:1.0:1788918578.669058:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:1.0:1788918578.669071:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+22:10321:x1875816855145344:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788918578.669104:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918578.669131:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9173 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f044f expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.669478:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac917a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.669520:0:5924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0448 expref: 23 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.669531:0:5924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac917a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.669578:0:5924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0448 expref: 23 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.669595:0:5924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0448 expref: 23 pid: 5925 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918578.669613:0:5924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd46300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865658368:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918578.669747:0:5924:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd05af6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918578.672441:0:5924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd46300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865658368:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918578.672482:0:5924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac917a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918578.673967:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918578.674415:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855145472 00000100:00100000:0.0:1788918578.674428:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855145472 00010000:00010000:0.0:1788918578.674482:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0448 expref: 24 pid: 5925 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918578.674525:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:0.0:1788918578.674536:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+24:2349:x1875816855145472:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918578.674558:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918578.674566:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0448 expref: 24 pid: 5925 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.674583:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0448 expref: 24 pid: 5925 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.674620:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac915e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0448 expref: 24 pid: 5925 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.674639:0:7989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:0.0:1788918578.674645:0:7989:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac917a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.674656:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac917a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.674825:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac917a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.674866:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918578.674942:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+23:2349:x1875816855145472:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 407us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918578.674950:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 41 00010000:00010000:1.0:1788918578.676212:0:5924:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac917a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.676226:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac917a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918578.676309:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788918578.676314:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788918578.676344:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac917a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.676417:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9173 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f044f expref: 23 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.676440:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac917a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f044f expref: 22 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.676449:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:1.0:1788918578.676452:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788918578.676456:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5c00, rc 0) 00000100:00100000:1.0:1788918578.676529:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+22:10321:x1875816855145344:12345-192.168.202.49@tcp:101:bash.0 Request processed in 7461us (7830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918578.676538:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:2.0:1788918578.680890:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918578.680998:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855145728 00000100:00100000:1.0:1788918578.681014:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855145728 00000100:00100000:1.0:1788918578.681124:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:1.0:1788918578.681137:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc7199850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+22:10321:x1875816855145728:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:1.0:1788918578.681488:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc7199850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+23:10321:x1875816855145728:12345-192.168.202.49@tcp:35:bash.0 Request processed in 352us (618us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788918578.681496:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:3.0:1788918578.830830:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918578.831227:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855145984 00000100:00100000:0.0:1788918578.831245:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855145984 00000100:00100000:0.0:1788918578.831341:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:0.0:1788918578.831365:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+23:10331:x1875816855145984:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918578.831405:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918578.831444:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9181 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0456 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918578.831636:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788918578.831824:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9181 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0456 expref: 25 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.831848:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:0.0:1788918578.831851:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788918578.831859:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9181 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0456 expref: 25 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.831882:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21a00, rc 0) 00000100:00100000:0.0:1788918578.831987:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+24:10331:x1875816855145984:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 634us (1174us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788918578.832075:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:3.0:1788918578.836862:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918578.837089:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855146112 00000100:00100000:2.0:1788918578.837105:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855146112 00000100:00100000:2.0:1788918578.837199:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00100000:2.0:1788918578.837213:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+24:10331:x1875816855146112:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:2.0:1788918578.837365:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac918f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837395:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac918f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837414:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac918f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837433:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837441:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837447:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837549:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac919d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837564:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac919d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837571:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac919d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788918578.837639:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac919d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837656:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac918f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837664:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac918f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837673:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac918f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837681:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918578.837688:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac918f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837697:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac918f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837714:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:2.0:1788918578.837717:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918578.837724:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac918f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837730:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac918f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837765:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837780:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9196 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837787:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837794:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dde00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918578.837797:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837804:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837812:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94ffff5d1300) 00010000:00010000:2.0:1788918578.837814:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918578.837817:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9196 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837824:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837843:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac919d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837849:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac919d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837855:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac919d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837866:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dcc00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918578.837870:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac919d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837877:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac919d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837886:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:2.0:1788918578.837889:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918578.837892:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac919d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.837897:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac919d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918578.838000:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+24:10331:x1875816855146112:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 789us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918578.838009:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 62 00010000:00010000:2.0:1788918578.838948:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918578.841451:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918578.841658:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855146368 00000100:00100000:3.0:1788918578.841672:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855146368 00000100:00100000:3.0:1788918578.841759:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:3.0:1788918578.841781:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+24:10331:x1875816855146368:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788918578.842173:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+25:10331:x1875816855146368:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 401us (736us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788918578.842182:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:3.0:1788918578.889150:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918578.889430:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855146624 00000100:00100000:0.0:1788918578.889455:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855146624 00000100:00100000:0.0:1788918578.889587:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:0.0:1788918578.889602:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+25:10334:x1875816855146624:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918578.889639:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918578.889664:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac91a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f045d expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.889768:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac91ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.889787:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac91ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.889803:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac91ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.889823:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac91b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.889842:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac91b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.889854:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac91b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890168:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac91b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890195:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac91b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890203:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac91b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918578.890214:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788918578.890327:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac91ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890335:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac91ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890343:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac91ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890349:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918578.890354:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac91ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890361:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac91ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890373:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:0.0:1788918578.890377:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918578.890382:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac91ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890388:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac91ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890401:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac91b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890413:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac91b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890420:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac91b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890425:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918578.890428:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac91b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890435:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac91b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890444:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94fff6819200) 00010000:00010000:0.0:1788918578.890447:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918578.890449:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac91b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890454:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac91b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890507:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac91a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f045d expref: 28 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890523:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac91b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f045d expref: 27 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918578.890530:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:0.0:1788918578.890532:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788918578.890542:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21400, rc 0) 00000100:00100000:0.0:1788918578.890645:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+27:10334:x1875816855146624:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1046us (1515us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788918578.890655:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:0.0:1788918578.895208:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918578.897590:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855146752 00000100:00100000:2.0:1788918578.897619:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855146752 00000100:00100000:2.0:1788918578.897749:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00100000:2.0:1788918578.897770:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+27:10334:x1875816855146752:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:2.0:1788918578.897883:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac91c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.897908:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac91c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.897946:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac91c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.897996:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac91c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.898005:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac91c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.898013:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac91c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.898049:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dde00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918578.898057:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac91c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.898066:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac91c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.898083:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:2.0:1788918578.898087:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788918578.898093:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac91c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918578.898100:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac91c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918578.901215:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918578.901301:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855146880 00000100:00100000:1.0:1788918578.901316:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855146880 00000100:00100000:1.0:1788918578.901418:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:1.0:1788918578.901433:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+28:2349:x1875816855146880:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918578.901453:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918578.901491:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac91b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f045d expref: 28 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918578.901535:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:1.0:1788918578.901542:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918578.901645:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+27:10334:x1875816855146752:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 3875us (6450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918578.901657:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00100000:1.0:1788918578.904852:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+26:2349:x1875816855146880:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 3399us (3632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918578.904879:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:3.0:1788918578.907875:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918578.908937:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855147136 00000100:00100000:1.0:1788918578.908961:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855147136 00000100:00100000:1.0:1788918578.909061:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:1.0:1788918578.909075:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+26:10334:x1875816855147136:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:1.0:1788918578.910080:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+27:10334:x1875816855147136:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 1002us (2323us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788918578.910092:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:2.0:1788918579.112472:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918579.112593:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855147392 00000100:00100000:3.0:1788918579.112616:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855147392 00000100:00100000:3.0:1788918579.112720:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:3.0:1788918579.112734:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+27:10352:x1875816855147392:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:3.0:1788918579.112776:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918579.112807:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0464 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.112968:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.112987:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.113002:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918579.113170:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788918579.113327:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0464 expref: 30 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.113353:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0464 expref: 29 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.113365:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:3.0:1788918579.113368:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788918579.113373:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4c00, rc 0) 00000100:00080000:2.0:1788918579.113530:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918579.113623:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+29:10352:x1875816855147392:12345-192.168.202.49@tcp:101:cat.0 Request processed in 891us (1172us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788918579.113644:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:0.0:1788918579.138830:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918579.139075:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855147520 00000100:00100000:3.0:1788918579.139090:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855147520 00000100:00100000:3.0:1788918579.139179:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:3.0:1788918579.139193:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+29:10353:x1875816855147520:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918579.139227:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918579.139254:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f046b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.139342:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac91ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.139360:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac91ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.139375:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac91ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918579.139432:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788918579.139436:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918579.139460:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac91ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.139492:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f046b expref: 31 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.139513:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac91ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f046b expref: 30 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.139545:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:3.0:1788918579.139549:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788918579.139553:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5a00, rc 0) 00000100:00100000:3.0:1788918579.139651:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+30:10353:x1875816855147520:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 460us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918579.139660:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:1.0:1788918579.145083:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918579.145219:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855147904 00000100:00100000:2.0:1788918579.145233:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855147904 00000100:00100000:2.0:1788918579.145344:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:2.0:1788918579.145358:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+30:10353:x1875816855147904:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:2.0:1788918579.146148:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+31:10353:x1875816855147904:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 788us (1082us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788918579.146168:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:0.0:1788918579.150002:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918579.150151:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855148032 00000100:00100000:3.0:1788918579.150227:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855148032 00000100:00100000:3.0:1788918579.150341:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:3.0:1788918579.150357:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+31:10353:x1875816855148032:12345-192.168.202.49@tcp:103:lfs.0 00010000:00010000:3.0:1788918579.150381:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788918579.150420:0:8796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac917a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f044f expref: 31 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.150450:0:8796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0464 expref: 30 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.150466:0:8796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac9070 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0409 expref: 29 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.150476:0:8796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:3.0:1788918579.150484:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918579.150580:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+28:10353:x1875816855148032:12345-192.168.202.49@tcp:103:lfs.0 Request processed in 225us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918579.150597:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:1.0:1788918579.153491:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918579.153580:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855148160 00000100:00100000:3.0:1788918579.153601:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855148160 00000100:00100000:3.0:1788918579.153691:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 67 00000100:00100000:3.0:1788918579.153704:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+28:10353:x1875816855148160:12345-192.168.202.49@tcp:58:lfs.0 00010000:00010000:3.0:1788918579.153870:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.154365:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.154385:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788918579.158865:0:5926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788918579.159081:0:5926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788918579.159212:0:5926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788918579.159336:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+28:10353:x1875816855148160:12345-192.168.202.49@tcp:58:lfs.0 Request processed in 5628us (5854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918579.159355:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 67 00000100:00100000:1.0:1788918579.211677:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918579.212400:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855148288 00000100:00100000:3.0:1788918579.212419:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855148288 00000100:00100000:3.0:1788918579.212701:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00100000:3.0:1788918579.212716:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+28:10355:x1875816855148288:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918579.212743:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918579.212783:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac91f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0472 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.212887:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.212918:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.213097:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.213120:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9206 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.213145:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.213302:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.213407:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac920d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.213418:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac920d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.213426:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac920d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918579.213480:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788918579.213486:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918579.213510:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac920d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.213524:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac920d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214315:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214330:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214338:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214363:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918579.214369:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214378:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214394:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:3.0:1788918579.214398:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918579.214404:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214411:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac91ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214430:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214435:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9206 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214440:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9206 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214445:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918579.214447:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9206 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214454:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9206 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214472:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94fff4b4e700) 00010000:00010000:3.0:1788918579.214475:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918579.214478:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9206 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214484:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9206 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214536:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac91f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0472 expref: 30 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214563:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac920d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0472 expref: 29 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.214572:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:3.0:1788918579.214575:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788918579.214578:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4800, rc 0) 00000100:00100000:3.0:1788918579.215377:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+29:10355:x1875816855148288:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 2660us (3708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918579.215388:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00100000:0.0:1788918579.798318:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865658624:0@lo:400:kworker.0 00000100:00100000:0.0:1788918579.798388:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918579.798438:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865659136:0@lo:400:kworker.0 00000100:00100000:0.0:1788918579.798465:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918579.798496:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788918579.798502:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865658752:0@lo:400:kworker.0 00000100:00100000:0.0:1788918579.798526:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918579.798562:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865658624 00000100:00100000:0.0:1788918579.798570:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865658624 00000100:00100000:0.0:1788918579.798611:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865658752 00000100:00100000:0.0:1788918579.798615:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865658752 00000100:00100000:0.0:1788918579.798645:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788918579.798654:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865658624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918579.798705:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865658624:12345-0@lo:400:kworker.0 Request processed in 53us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918579.798832:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788918579.798853:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788918579.798861:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865658752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918579.798892:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865658752:12345-0@lo:400:kworker.0 Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918579.798912:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788918579.798932:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865659136 00000100:00100000:0.0:1788918579.798936:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865659136 00000100:00100000:0.0:1788918579.798965:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788918579.798971:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865659136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918579.799001:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865659136:12345-0@lo:400:kworker.0 Request processed in 31us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918579.799008:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788918579.799080:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865658752:0@lo:400:kworker.0 00000100:00100000:0.0:1788918579.799091:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865658624:0@lo:400:kworker.0 00000100:00100000:0.0:1788918579.799100:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865659136:0@lo:400:kworker.0 00000100:00100000:2.0:1788918579.799183:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865658496:0@lo:400:kworker.0 00000100:00100000:2.0:1788918579.799220:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918579.799255:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865659008:0@lo:400:kworker.0 00000100:00100000:2.0:1788918579.799278:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918579.799296:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788918579.799301:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865658880:0@lo:400:kworker.0 00000100:00100000:2.0:1788918579.799323:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918579.799352:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865659008 00000100:00100000:2.0:1788918579.799356:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865659008 00000100:00100000:2.0:1788918579.799388:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788918579.799394:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865659008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918579.799429:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865659008:12345-0@lo:400:kworker.0 Request processed in 35us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918579.799443:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1788918579.799465:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788918579.799469:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918579.799478:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865658880 00000100:00100000:2.0:1788918579.799482:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865658880 00000100:00100000:2.0:1788918579.799508:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788918579.799514:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3420:x1875816865658880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918579.799544:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3420:x1875816865658880:12345-0@lo:400:kworker.0 Request processed in 31us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918579.799551:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788918579.799570:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788918579.799586:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865658880:0@lo:400:kworker.0 00000100:00100000:2.0:1788918579.799597:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865659008:0@lo:400:kworker.0 00000100:00100000:0.0:1788918579.800280:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865658496 00000100:00100000:0.0:1788918579.800287:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865658496 00000100:00100000:0.0:1788918579.800323:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788918579.800330:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865658496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918579.800383:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865658496:12345-0@lo:400:kworker.0 Request processed in 53us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918579.800389:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788918579.800534:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865658496:0@lo:400:kworker.0 00000100:00100000:2.0:1788918579.813248:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788918579.813272:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefeda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865659264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918579.813343:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918579.813443:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865659264 00000100:00100000:1.0:1788918579.813450:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865659264 00000100:00100000:1.0:1788918579.813504:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788918579.813514:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865659264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918579.813542:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918579.813585:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865659264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918579.813592:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788918579.813676:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefeda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865659264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788918579.865294:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788918579.926225:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788918579.926235:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788918579.926276:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788918579.926284:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788918579.926449:0:12048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12048:1875816865659392:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788918579.926575:0:12048:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2af480 going to sleep for 11 seconds 00000100:00100000:0.0:1788918579.929817:0:12048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12048:1875816865659392:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788918579.931386:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918579.931452:0:5936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855148416 00000100:00100000:3.0:1788918579.931463:0:5936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855148416 00000100:00100000:3.0:1788918579.931523:0:5936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:3.0:1788918579.931534:0:5936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9b921db9-4859-438b-976e-b950f67eace4+29:10366:x1875816855148416:12345-192.168.202.49@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788918579.931625:0:5936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9b921db9-4859-438b-976e-b950f67eace4+29:10366:x1875816855148416:12345-192.168.202.49@tcp:900:lhsmtool_posix.0 Request processed in 93us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918579.931651:0:5936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:1.0:1788918579.933881:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918579.934432:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855148544 00000100:00100000:0.0:1788918579.934442:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855148544 00000100:00100000:0.0:1788918579.934506:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:0.0:1788918579.934518:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefeda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+29:10366:x1875816855148544:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788918579.934547:0:5926:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788918579.934684:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefeda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+29:10366:x1875816855148544:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 168us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918579.934693:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:1.0:1788918579.946098:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918579.946586:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855148672 00000100:00100000:0.0:1788918579.946597:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855148672 00000100:00100000:0.0:1788918579.946700:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:0.0:1788918579.946712:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+29:10366:x1875816855148672:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788918579.946802:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9214 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.946822:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9214 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.946836:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9214 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.946873:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac921b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.946881:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac921b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.946888:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac921b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947001:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9222 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947012:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947036:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918579.947083:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788918579.947087:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788918579.947101:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947113:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9214 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947120:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9214 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947127:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9214 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947133:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918579.947137:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9214 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947145:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9214 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947159:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94fffbdf3600) 00010000:00010000:0.0:1788918579.947169:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918579.947175:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9214 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947180:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9214 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947191:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac921b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947197:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac921b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947202:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac921b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947207:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918579.947209:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac921b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947213:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac921b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947219:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff94fff6819a00) 00010000:00010000:0.0:1788918579.947221:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918579.947224:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac921b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947229:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac921b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947242:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947255:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9222 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947260:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947264:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918579.947267:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947274:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947282:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:0.0:1788918579.947284:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918579.947287:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9222 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918579.947293:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9222 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918579.947541:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+29:10366:x1875816855148672:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 Request processed in 830us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918579.947549:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:1.0:1788918579.951364:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918579.951725:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855148928 00000100:00100000:2.0:1788918579.951736:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855148928 00000100:00100000:2.0:1788918579.951800:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 71 00000100:00100000:2.0:1788918579.951810:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+29:10366:x1875816855148928:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788918579.951830:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918579.951851:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9229 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0479 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.951980:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9230 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.951996:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.952008:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918579.952042:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788918579.952129:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.952138:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9230 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.952145:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.952163:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dde00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918579.952168:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.952176:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9230 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.952190:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:2.0:1788918579.952193:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788918579.952198:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9230 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.952213:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9230 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.952255:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9229 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0479 expref: 31 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.952266:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94fffbdf3600) 00010000:00010000:2.0:1788918579.952269:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788918579.952273:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9229 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0479 expref: 31 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.952282:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48ddc00, rc 0) 00000100:00100000:2.0:1788918579.952340:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+30:10366:x1875816855148928:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 532us (987us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788918579.952348:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 71 00000100:00100000:1.0:1788918579.958807:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918579.958854:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855149056 00000100:00100000:3.0:1788918579.958863:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855149056 00000100:00100000:3.0:1788918579.959440:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 72 00000100:00100000:3.0:1788918579.959574:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+30:10366:x1875816855149056:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788918579.959616:0:11359:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788918579.963171:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+30:10366:x1875816855149056:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 3594us (4364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918579.963185:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 72 00000100:00100000:2.0:1788918579.969298:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918579.972174:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855149312 00000100:00100000:3.0:1788918579.972188:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855149312 00000100:00100000:3.0:1788918579.972274:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 73 00000100:00100000:3.0:1788918579.972286:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+30:10366:x1875816855149312:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788918579.972318:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918579.972321:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788918579.972348:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac91ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f046b expref: 30 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.972369:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:3.0:1788918579.972375:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918579.972389:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac923e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0480 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788918579.972864:0:5925:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788918579.973054:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9245 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.973081:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.973092:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.973150:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac923e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0480 expref: 32 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.973165:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0480 expref: 31 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.973173:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94fff4b4e200) 00010000:00010000:3.0:1788918579.973176:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788918579.973179:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4c00, rc 0) 00000100:00100000:3.0:1788918579.973250:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+31:10366:x1875816855149312:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 965us (3960us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788918579.973258:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 73 00000100:00100000:2.0:1788918579.984644:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918579.984726:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855149568 00000100:00100000:3.0:1788918579.984735:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855149568 00000100:00100000:3.0:1788918579.984806:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 74 00000100:00100000:3.0:1788918579.984816:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+31:10366:x1875816855149568:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788918579.984879:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918579.984904:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9245 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0480 expref: 31 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.984942:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94fff4b4e200) 00010000:00010000:3.0:1788918579.984960:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918579.984983:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9253 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.984998:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9253 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985008:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9253 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985089:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac925a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x348d5674 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985098:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac925a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x348d5674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985105:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac925a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x348d5674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985150:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9253 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985158:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9253 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985164:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9253 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985170:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918579.985174:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9253 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985182:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9253 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985197:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:3.0:1788918579.985200:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918579.985204:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9253 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985210:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9253 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985220:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac925a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x348d5674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985227:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac925a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x348d5674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985232:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac925a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x348d5674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985237:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918579.985240:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac925a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x348d5674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985246:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac925a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x348d5674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985252:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x348d5674 (ffff94fff4b4e700) 00010000:00010000:3.0:1788918579.985254:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918579.985258:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac925a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x348d5674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.985263:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac925a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x348d5674 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918579.985368:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+30:10366:x1875816855149568:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 553us (734us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788918579.985376:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 74 00000100:00100000:3.0:1788918579.989050:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918579.989437:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855149696 00000100:00100000:2.0:1788918579.989448:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855149696 00000100:00100000:2.0:1788918579.989512:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 75 00000100:00100000:2.0:1788918579.989522:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+30:10366:x1875816855149696:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788918579.989544:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918579.989567:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9261 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0487 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.989603:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9268 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.989633:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.989645:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.989775:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9261 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0487 expref: 32 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.989797:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0487 expref: 31 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918579.989806:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94ffff5d1300) 00010000:00010000:2.0:1788918579.989809:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788918579.989812:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dde00, rc 0) 00000100:00100000:2.0:1788918579.989885:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+31:10366:x1875816855149696:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 364us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918579.989892:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 75 00000100:00100000:2.0:1788918579.998450:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918579.998524:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855149952 00000100:00100000:3.0:1788918579.998535:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855149952 00000100:00100000:3.0:1788918579.998599:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 76 00000100:00100000:3.0:1788918579.998609:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+31:10366:x1875816855149952:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788918579.998734:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac926f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.998763:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac926f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918579.998775:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac926f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788918579.999008:0:5926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788918579.999045:0:5926:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 282280023728ns, next at 283279995089ns, rc = 0 00000004:00010000:3.0:1788918579.999098:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099a7f3a1 reply state 000000000546fac9 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac926f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918579.999106:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788918579.999209:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+33:10366:x1875816855149952:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 600us (769us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788918579.999216:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 76 00010000:00010000:3.0:1788918580.002069:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac926f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.002095:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac926f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.002103:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac926f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.002109:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918580.002114:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac926f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.002122:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac926f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.002145:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94ffff5d1300) 00010000:00010000:3.0:1788918580.002147:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788918580.002165:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac926f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.002172:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac926f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918580.003973:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.004448:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855150080 00000100:00100000:3.0:1788918580.004460:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855150080 00000100:00100000:3.0:1788918580.004529:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00100000:3.0:1788918580.004540:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+32:10366:x1875816855150080:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788918580.004568:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918580.004601:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9276 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f048e expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.004670:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9276 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f048e expref: 33 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.004694:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9276 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f048e expref: 33 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.004716:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94ffff5d1300) 00010000:00010000:3.0:1788918580.004720:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788918580.004724:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0031400, rc 0) 00000100:00100000:3.0:1788918580.004830:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+33:10366:x1875816855150080:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 291us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918580.004838:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00100000:0.0:1788918580.008340:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.008430:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855150208 00000100:00100000:3.0:1788918580.008441:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855150208 00000100:00100000:3.0:1788918580.008490:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:3.0:1788918580.008500:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875816855150208:12345-192.168.202.49@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788918580.008536:0:6912:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:3.0:1788918580.008570:0:6912:0:(genops.c:1385:class_connect()) connect: client 9b921db9-4859-438b-976e-b950f67eace4, cookie 0x2811b8b2b0ac927d 00002000:00100000:3.0:1788918580.008597:0:6912:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9b921db9-4859-438b-976e-b950f67eace4/ffff94ffc70cb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788918580.008610:0:6912:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788918580.008705:0:6912:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788918580.008759:0:6912:0:(import.c:65:import_set_state_nolock()) ffff94fffdafd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788918580.008835:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2348:x1875816855150208:12345-192.168.202.49@tcp:8:lhsmtool_posix.0 Request processed in 334us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918580.008843:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:3.0:1788918580.025621:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918580.025706:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855150336 00000100:00100000:2.0:1788918580.025717:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855150336 00000100:00100000:2.0:1788918580.025806:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:2.0:1788918580.025817:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+6:0:x1875816855150336:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788918580.026264:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788918580.028165:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1788918580.028177:0:7980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00000100:00100000:3.0:1788918580.028357:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:0:x1875816855150336:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 2536us (2740us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788918580.028368:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:3.0:1788918580.031232:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918580.031331:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855150592 00000100:00100000:1.0:1788918580.031341:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855150592 00000100:00100000:1.0:1788918580.031399:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:1.0:1788918580.031410:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+33:10366:x1875816855150592:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788918580.031638:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+34:10366:x1875816855150592:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 229us (418us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788918580.031645:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:0.0:1788918580.038463:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.038542:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855150848 00000100:00100000:3.0:1788918580.038553:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855150848 00000100:00100000:3.0:1788918580.038615:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 78 00000100:00100000:3.0:1788918580.038625:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+34:10366:x1875816855150848:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788918580.038787:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+34:10366:x1875816855150848:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 162us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918580.038794:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 78 00000100:00100000:0.0:1788918580.056040:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.057091:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855150976 00000100:00100000:3.0:1788918580.057103:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855150976 00000100:00100000:3.0:1788918580.057167:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:3.0:1788918580.057177:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+34:10366:x1875816855150976:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788918580.057198:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918580.057220:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9284 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0495 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.057283:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac928b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.057297:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac928b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.057310:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac928b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918580.057355:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918580.057388:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac928b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.057413:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9284 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0495 expref: 36 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.057431:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac928b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0495 expref: 35 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.057439:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94ffff5d1300) 00010000:00010000:3.0:1788918580.057442:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788918580.057446:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0030800, rc 0) 00000100:00100000:3.0:1788918580.057499:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+35:10366:x1875816855150976:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 324us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918580.057506:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:3.0:1788918580.062411:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918580.067774:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855151104 00000100:00100000:0.0:1788918580.067795:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855151104 00000100:00100000:0.0:1788918580.067871:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:0.0:1788918580.067882:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+5:2349:x1875816855151104:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788918580.067901:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918580.067924:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db4b940d/0x2811b8b2b0ac9292 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f049c expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788918580.067949:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0bb32, blocks: 0x0 00010000:00010000:0.0:1788918580.067967:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=282s v=(0 0) 00010000:00010000:0.0:1788918580.067972:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918580.067981:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db4b940d/0x2811b8b2b0ac9292 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f049c expref: 6 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.067999:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db4b940d/0x2811b8b2b0ac9292 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f049c expref: 6 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.068014:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20800, rc 0) 00000100:00100000:0.0:1788918580.068952:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855151104:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 1068us (6553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918580.068962:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:0.0:1788918580.102965:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.104918:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855151360 00000100:00100000:3.0:1788918580.104933:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855151360 00000100:00100000:3.0:1788918580.104997:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:3.0:1788918580.105008:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+35:10366:x1875816855151360:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788918580.105146:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+35:10366:x1875816855151360:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 139us (2192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918580.105154:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:0.0:1788918580.107849:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918580.107924:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855151488 00000100:00100000:1.0:1788918580.107933:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855151488 00000100:00100000:1.0:1788918580.107988:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:1.0:1788918580.107998:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:10366:x1875816855151488:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788918580.108016:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918580.108055:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac9299 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04a3 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.108085:0:6909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db4b940d/0x2811b8b2b0ac9292 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f049c expref: 7 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.108094:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918580.108098:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918580.108104:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac9299 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04a3 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.108138:0:6909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db4b940d/0x2811b8b2b0ac9292 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f049c expref: 7 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.108158:0:6909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db4b940d/0x2811b8b2b0ac9292 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f049c expref: 7 pid: 6912 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918580.108173:0:6909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6909:1875816865659520:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918580.110890:0:6909:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe9846cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918580.129205:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.129247:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855151616 00000100:00100000:3.0:1788918580.129256:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855151616 00010000:00010000:3.0:1788918580.129298:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db4b940d/0x2811b8b2b0ac9292 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f049c expref: 8 pid: 6912 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918580.129397:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:3.0:1788918580.129408:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5095850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+8:2350:x1875816855151616:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918580.129424:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918580.129445:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db4b940d/0x2811b8b2b0ac9292 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f049c expref: 8 pid: 6912 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.129461:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db4b940d/0x2811b8b2b0ac9292 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f049c expref: 8 pid: 6912 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.129493:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918580.129498:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918580.129507:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac9299 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04a3 expref: 8 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.129517:0:5909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac9299 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04a3 expref: 8 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.129560:0:5909:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac9299 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04a3 expref: 8 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918580.129575:0:5909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5909:1875816865659648:192.168.202.49@tcp:105: 00000100:00100000:3.0:1788918580.129676:0:5909:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe286ac00 going to sleep for 11 seconds 00010000:00010000:0.0:1788918580.130061:0:6909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db4b940d/0x2811b8b2b0ac9292 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f049c expref: 8 pid: 6912 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918580.130078:0:6909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6909:1875816865659520:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918580.130115:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac9299 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04a3 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.130127:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5400, rc 0) 00000100:00100000:0.0:1788918580.130169:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+7:10366:x1875816855151488:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 22172us (22332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918580.130176:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:3.0:1788918580.139355:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918580.139453:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855151744 00000100:00100000:0.0:1788918580.139462:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855151744 00002000:00100000:0.0:1788918580.139512:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff94ffefc8fb80 x1875816855151744/t0(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:451/0 lens 504/0 e 0 to 0 dl 1788918591 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788918580.139524:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffefc8fb80 with x1875816855151744 ext(0->8) 00002000:00010000:0.0:1788918580.139529:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffefc8fb80 00000100:00100000:0.0:1788918580.139564:0:6917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:0.0:1788918580.139574:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b921db9-4859-438b-976e-b950f67eace4+7:2351:x1875816855151744:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788918580.142069:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b921db9-4859-438b-976e-b950f67eace4+9:2351:x1875816855151744:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 Request processed in 2482us (2712us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788918580.142084:0:6917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00002000:00100000:0.0:1788918580.142100:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff94ffefc8fb80 x1875816855151744/t4294967302(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:451/0 lens 504/448 e 0 to 0 dl 1788918591 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788918580.142112:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffefc8fb80 with x1875816855151744 ext(0->8) 00002000:00010000:0.0:1788918580.142120:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffefc8fb80 00000100:00100000:1.0:1788918580.142466:0:5909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5909:1875816865659648:192.168.202.49@tcp:105: 00010000:00010000:1.0:1788918580.142492:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918580.142535:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5095850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+8:2350:x1875816855151616:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 13129us (13341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918580.142544:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:0.0:1788918580.160924:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.162646:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855151872 00000100:00100000:3.0:1788918580.162670:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855151872 00000100:00100000:3.0:1788918580.162737:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00100000:3.0:1788918580.162759:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+35:10366:x1875816855151872:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 00000040:00080000:2.0:1788918580.166575:0:12356:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788918580.166586:0:12356:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788918580.166618:0:12356:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788918580.166626:0:12356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1788918580.176641:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788918580.176655:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788918580.176709:0:5903:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788918580.176735:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788918580.176755:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788918580.176890:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+14:10366:x1875816855151872:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 Request processed in 14127us (15968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918580.176902:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00100000:0.0:1788918580.177430:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788918580.177455:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865659776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788918580.177509:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918580.177660:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865659776 00000100:00100000:3.0:1788918580.177669:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865659776 00000100:00100000:3.0:1788918580.177720:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788918580.177731:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865659776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788918580.177862:0:7258:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788918580.177866:0:7258:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788918578 00002000:00010000:3.0:1788918580.177869:0:7258:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788918580.177871:0:7258:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788918578 -> 1788918578 00002000:00010000:3.0:1788918580.177874:0:7258:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788918580.177924:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3420:x1875816865659776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (413us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788918580.177933:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1788918580.177971:0:3420:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94ffff84f800/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788918580.177978:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865659776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788918580.182214:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.182301:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855152000 00000100:00100000:3.0:1788918580.182313:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855152000 00000100:00100000:3.0:1788918580.182374:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:3.0:1788918580.182385:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+8:2350:x1875816855152000:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788918580.197765:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1788918580.197781:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1788918580.197938:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2350:x1875816855152000:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 Request processed in 15550us (15727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918580.197951:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:0.0:1788918580.211919:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918580.211976:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855152256 00000100:00100000:0.0:1788918580.211986:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855152256 00000100:00100000:0.0:1788918580.212072:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 82 00000100:00100000:0.0:1788918580.212084:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+14:10366:x1875816855152256:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788918580.212155:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918580.212192:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac928b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0495 expref: 14 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.212210:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94ffff5d1300) 00010000:00010000:0.0:1788918580.212215:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918580.212242:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac92a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.212256:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac92a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.212266:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac92a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788918580.212415:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a55d352b reply state 00000000210f3d71 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac92a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918580.212424:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788918580.212523:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+15:10366:x1875816855152256:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 441us (614us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788918580.212541:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 82 00010000:00010000:3.0:1788918580.241269:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac92a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.241289:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac92a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.241296:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac92a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.241302:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918580.241307:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac92a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.241316:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac92a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.241334:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94ffff5d1300) 00010000:00010000:3.0:1788918580.241337:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918580.241344:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac92a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.241350:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac92a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918580.243813:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.244066:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855152384 00000100:00100000:3.0:1788918580.244076:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855152384 00000100:00100000:1.0:1788918580.244217:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:1.0:1788918580.244232:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855152384:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788918580.244422:0:7258:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788918580.244426:0:7258:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788918578 -> 1788918577 00002000:00010000:1.0:1788918580.244429:0:7258:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788918575 00002000:00010000:1.0:1788918580.244431:0:7258:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788918578 -> 1788918577 00002000:00010000:1.0:1788918580.244433:0:7258:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788918580.244496:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855152384:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 268us (691us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788918580.244504:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:0.0:1788918580.259884:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.259988:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855152640 00000100:00100000:3.0:1788918580.259998:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855152640 00000100:00100000:3.0:1788918580.260097:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 83 00000100:00100000:3.0:1788918580.260108:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+14:10366:x1875816855152640:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788918580.260185:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.260204:0:5925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9268 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0487 expref: 14 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.260215:0:5925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.260252:0:5925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0487 expref: 14 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.260265:0:5925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9268 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0487 expref: 14 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918580.260279:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865659904:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918580.260386:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe286ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788918580.266285:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918580.266852:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855152768 00000100:00100000:0.0:1788918580.266863:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855152768 00010000:00010000:0.0:1788918580.266906:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9268 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0487 expref: 15 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918580.266952:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:0.0:1788918580.266963:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+15:2350:x1875816855152768:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918580.266978:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918580.266985:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9268 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0487 expref: 15 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.266999:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9268 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0487 expref: 15 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.267049:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94ffff5d1300) 00010000:00010000:0.0:1788918580.267055:0:5910:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.267065:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.267073:0:5910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.267094:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918580.267156:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+15:2350:x1875816855152768:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 195us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918580.267163:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 43 00010000:00010000:3.0:1788918580.268892:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9268 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0487 expref: 14 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918580.268916:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865659904:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918580.268941:0:5925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.268952:0:5925:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.268971:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.269009:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.269017:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.269928:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.269936:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918580.269941:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.269951:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.269969:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94ffff5d1300) 00010000:00010000:3.0:1788918580.269973:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788918580.269979:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.269986:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918580.270216:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+13:10366:x1875816855152640:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 Request processed in 10105us (10340us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788918580.270227:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 83 00000100:00100000:1.0:1788918580.287217:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918580.287460:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855152896 00000100:00100000:0.0:1788918580.287470:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855152896 00000100:00100000:0.0:1788918580.287541:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:0.0:1788918580.287551:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+7:2351:x1875816855152896:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788918580.287593:0:6909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.287613:0:6909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac9299 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04a3 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.287622:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918580.287627:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788918580.287632:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.287676:0:6909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac9299 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04a3 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.287691:0:6909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac9299 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04a3 expref: 7 pid: 6909 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918580.287705:0:6909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff84ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6909:1875816865660032:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918580.287799:0:6909:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2af0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918580.300201:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.300337:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855153024 00000100:00100000:3.0:1788918580.300346:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855153024 00010000:00010000:3.0:1788918580.300388:0:8796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac9299 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04a3 expref: 8 pid: 6909 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918580.300437:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:3.0:1788918580.300447:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+8:2349:x1875816855153024:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918580.300463:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918580.300486:0:8796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac9299 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04a3 expref: 8 pid: 6909 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.300502:0:8796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac9299 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04a3 expref: 8 pid: 6909 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.300526:0:8796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788918580.300531:0:8796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788918580.300538:0:8796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.300548:0:8796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.300571:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918580.300620:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+8:2349:x1875816855153024:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 174us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918580.300627:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 44 00010000:00010000:1.0:1788918580.302048:0:6909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac9299 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04a3 expref: 7 pid: 6909 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918580.302067:0:6909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff84ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6909:1875816865660032:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918580.302092:0:6909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.302104:0:6909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.302112:0:6909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.302144:0:6909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.302153:0:6909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.302162:0:6909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.302169:0:6909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21600 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918580.302175:0:6909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.302193:0:6909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.302214:0:6909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.302222:0:6909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000338a0989/0x2811b8b2b0ac92ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918580.302293:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855152896:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 Request processed in 14742us (15085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918580.302315:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:0.0:1788918580.310505:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.310772:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855153280 00000100:00100000:3.0:1788918580.310798:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855153280 00000100:00100000:3.0:1788918580.310863:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:3.0:1788918580.310872:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+13:10366:x1875816855153280:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788918580.310956:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.310974:0:5926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac90fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f042c expref: 13 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.310984:0:5926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.311051:0:5926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac90fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f042c expref: 13 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.311067:0:5926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac90fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f042c expref: 13 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918580.311081:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865660160:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918580.311177:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe286ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788918580.327076:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.327126:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865660160:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918580.327165:0:5926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918580.327514:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855153408 00000100:00100000:1.0:1788918580.327522:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855153408 00010000:00010000:1.0:1788918580.327559:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac90fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f042c expref: 14 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918580.327596:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:1.0:1788918580.327606:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+14:2349:x1875816855153408:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918580.327622:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918580.327629:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac90fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f042c expref: 14 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.327642:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac90fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f042c expref: 14 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.327688:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac90fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f042c expref: 14 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.327703:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:1.0:1788918580.327708:0:5909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.327717:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.327724:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.327765:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918580.327816:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+13:2349:x1875816855153408:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 210us (746us total) trans 0 rc 0/0 00010000:00010000:3.0:1788918580.327820:0:5926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918580.327828:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 45 00010000:00010000:3.0:1788918580.327836:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.328096:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.328112:0:5926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9276 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f048e expref: 13 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.328122:0:5926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.328167:0:5926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9276 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f048e expref: 13 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918580.328182:0:5926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9276 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f048e expref: 13 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918580.328197:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865660288:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918580.328251:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd80f86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918580.333938:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.334078:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865660288:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918580.334104:0:5926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918580.336780:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855153536 00000100:00100000:2.0:1788918580.336796:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855153536 00010000:00010000:2.0:1788918580.336848:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9276 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f048e expref: 14 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918580.336895:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:2.0:1788918580.336905:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+14:2350:x1875816855153536:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918580.336920:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918580.336927:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9276 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f048e expref: 14 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.336941:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9276 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f048e expref: 14 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.336961:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9276 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f048e expref: 14 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.336979:0:7989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94ffff5d1300) 00010000:00010000:2.0:1788918580.336985:0:7989:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.336994:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.337001:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.337073:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918580.337132:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+13:2350:x1875816855153536:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 228us (3203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918580.337141:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 46 00010000:00010000:2.0:1788918580.337184:0:5926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.337192:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788918580.337309:0:5926:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788918580.337426:0:5926:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788918580.337460:0:5926:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788918580.337537:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff817480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5926:1875816865660416:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788918580.337593:0:5926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918580.337622:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918580.337816:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865660416 00000100:00100000:0.0:1788918580.337822:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865660416 00000100:00100000:0.0:1788918580.337864:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788918580.337873:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5926:x1875816865660416:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788918580.337950:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5926:x1875816865660416:12345-0@lo:1000:mdt00_002.0 Request processed in 78us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918580.337957:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788918580.338007:0:5926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788918580.338012:0:5926:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94ffff84f800, transno 4294967303 00000100:00100000:0.0:1788918580.338056:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff817480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5926:1875816865660416:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788918580.338211:0:5926:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788918580.338259:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff84ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5926:1875816865660544:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788918580.338288:0:5926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918580.338313:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffca0f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788918580.338440:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865660544 00000100:00100000:3.0:1788918580.338445:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865660544 00000100:00100000:3.0:1788918580.338471:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788918580.338480:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5926:x1875816865660544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788918580.338610:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5926:x1875816865660544:12345-0@lo:1000:mdt00_002.0 Request processed in 131us (320us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788918580.338626:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788918580.338882:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff84ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5926:1875816865660544:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788918580.338917:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.338926:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.338934:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.338951:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918580.338955:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.338963:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.338978:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94ffff5d1300) 00010000:00010000:0.0:1788918580.338981:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788918580.338986:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.338992:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac92bc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.339055:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.339063:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.339069:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.339074:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918580.339078:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.339085:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.339103:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:0.0:1788918580.339106:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788918580.339109:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.339115:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac91f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.339139:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.339165:0:5926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac920d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0472 expref: 16 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.339173:0:5926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.339196:0:5926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac920d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0472 expref: 16 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.339210:0:5926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac920d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0472 expref: 16 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918580.339222:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff84f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865660672:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918580.339299:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffca0f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788918580.347895:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff84f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865660672:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918580.347930:0:5926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918580.348573:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918580.348918:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855153664 00000100:00100000:1.0:1788918580.348926:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855153664 00010000:00010000:1.0:1788918580.348963:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac920d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0472 expref: 17 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918580.349005:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:1.0:1788918580.349015:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+17:2349:x1875816855153664:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918580.349059:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918580.349067:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac920d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0472 expref: 17 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.349079:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac920d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0472 expref: 17 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.349100:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac920d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0472 expref: 17 pid: 5924 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.349116:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:1.0:1788918580.349120:0:5911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.349130:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.349139:0:5911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.349319:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918580.349374:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+16:2349:x1875816855153664:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 359us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918580.349382:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 47 00010000:00010000:2.0:1788918580.352373:0:5926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352391:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352404:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352411:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352417:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352434:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918580.352439:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352447:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352464:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:2.0:1788918580.352467:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918580.352472:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352478:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac92c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352492:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352499:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352505:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352510:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918580.352513:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352519:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352537:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff4b4e600) 00010000:00010000:2.0:1788918580.352539:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788918580.352542:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918580.352548:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac92b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918580.353410:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+15:10366:x1875816855153280:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 42531us (42907us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788918580.353422:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 84 00000020:00080000:2.0:1788918580.353429:0:5926:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788918580.356249:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788918580.356258:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788918580.356279:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788918580.356293:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788918580.357776:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918580.362472:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855153920 00000100:00100000:1.0:1788918580.362490:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855153920 00000100:00100000:0.0:1788918580.364919:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:0.0:1788918580.364937:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+15:10366:x1875816855153920:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788918580.365332:0:5927:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788918580.365365:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788918580.365399:0:5927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac92ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.365416:0:5927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac92ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.365428:0:5927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac92ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.365436:0:5927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac92ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.365444:0:5927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac92ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.365451:0:5927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac92ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918580.365476:0:5927:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788918580.365557:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+17:10366:x1875816855153920:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 624us (7787us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788918580.365567:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00000020:00080000:0.0:1788918580.365572:0:5927:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788918580.365621:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918580.365630:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac92ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.365651:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21c00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918580.365655:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac92ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.365677:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac92ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.365691:0:5912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94fff6819f00) 00010000:00010000:1.0:1788918580.365694:0:5912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788918580.365698:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac92ca lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.365704:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac92ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918580.365720:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918580.365722:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918580.365723:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918580.396321:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.396363:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918580.396401:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918580.396470:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855154176 00000100:00100000:0.0:1788918580.396479:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855154176 00000100:00100000:0.0:1788918580.396553:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:0.0:1788918580.396564:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855154176:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918580.396637:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855154176:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 75us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918580.396645:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:0.0:1788918580.396667:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855154304 00000100:00100000:0.0:1788918580.396671:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855154304 00000100:00100000:0.0:1788918580.396701:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 135 00000100:00100000:0.0:1788918580.396708:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2350:x1875816855154304:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918580.396749:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2350:x1875816855154304:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 32us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918580.396756:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 135 00000100:00100000:2.0:1788918580.396941:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855154048 00000100:00100000:2.0:1788918580.396946:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855154048 00000100:00100000:2.0:1788918580.396984:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 284 00000100:00100000:2.0:1788918580.396992:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2350:x1875816855154048:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918580.397064:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2350:x1875816855154048:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 73us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918580.397070:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 284 00000100:00080000:3.0:1788918580.397340:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788918580.397344:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918580.822795:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865660800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918580.822909:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918580.823180:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865660800 00000100:00100000:3.0:1788918580.823190:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865660800 00000100:00100000:3.0:1788918580.823245:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788918580.823254:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3420:x1875816865660800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788918580.823283:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 28672 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918580.823333:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3420:x1875816865660800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918580.823340:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788918580.824620:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865660800:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788918580.886306:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918581.918670:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788918582.403532:0:12409:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788918582.403544:0:12409:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788918582.403567:0:12409:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788918582.403574:0:12409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788918582.584292:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918582.584442:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855154560 00000100:00100000:0.0:1788918582.584454:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855154560 00000100:00100000:0.0:1788918582.584530:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:0.0:1788918582.584541:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+17:10385:x1875816855154560:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918582.584573:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918582.584639:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac92d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04aa expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.584763:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac92d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.584780:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac92d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.584792:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac92d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918582.584820:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788918582.584923:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac92d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04aa expref: 20 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.584942:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac92d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04aa expref: 19 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.584950:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:0.0:1788918582.584952:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788918582.584955:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20000, rc 0) 00000100:00100000:0.0:1788918582.585012:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+19:10385:x1875816855154560:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 473us (729us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788918582.585052:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00080000:2.0:1788918582.585576:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918582.590851:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918582.592047:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855154688 00000100:00100000:2.0:1788918582.592059:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855154688 00000100:00100000:2.0:1788918582.592123:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 86 00000100:00100000:2.0:1788918582.592146:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+19:10385:x1875816855154688:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:2.0:1788918582.592225:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac92e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592259:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac92e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592271:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac92e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592319:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac92ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592327:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac92ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592335:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac92ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592436:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac92f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592445:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac92f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592453:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac92f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788918582.592501:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac92f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592516:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac92e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592522:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac92e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592539:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac92e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592545:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918582.592549:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac92e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592888:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac92e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592906:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:2.0:1788918582.592909:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918582.592915:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac92e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592921:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac92e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592934:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac92ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592940:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac92ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592945:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac92ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592950:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918582.592953:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac92ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592972:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac92ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592980:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94ffff5d1800) 00010000:00010000:2.0:1788918582.592982:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918582.592985:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac92ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.592990:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac92ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.593004:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac92f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.593010:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac92f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.593016:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac92f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.617188:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dce00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918582.617197:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac92f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.617209:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac92f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.617229:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1700) 00010000:00010000:2.0:1788918582.617232:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918582.617238:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac92f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.617265:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac92f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918582.617922:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+19:10385:x1875816855154688:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 25772us (27072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918582.617935:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 86 00000100:00100000:0.0:1788918582.689942:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918582.690245:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855154944 00000100:00100000:2.0:1788918582.690257:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855154944 00000100:00100000:2.0:1788918582.690318:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 87 00000100:00100000:2.0:1788918582.690327:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+19:10388:x1875816855154944:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788918582.690346:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918582.690365:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac92fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04b1 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.690434:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9302 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.690448:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9302 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.690459:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9302 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.690472:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9309 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.690479:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.690485:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.690586:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.690600:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.690607:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918582.690617:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788918582.690688:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9302 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.690695:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9302 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.690702:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9302 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.690708:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918582.690713:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9302 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.692062:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9302 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.692080:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:2.0:1788918582.692083:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918582.692089:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9302 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.692096:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9302 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.692108:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.692125:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9309 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.692131:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.692137:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918582.692140:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.692146:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9309 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.692153:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94ffff5d1700) 00010000:00010000:2.0:1788918582.692156:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918582.692158:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9309 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.692164:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9309 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.692220:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac92fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b1 expref: 22 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.692235:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b1 expref: 21 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.692242:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1800) 00010000:00010000:2.0:1788918582.692245:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918582.692253:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dde00, rc 0) 00000100:00100000:2.0:1788918582.692320:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+21:10388:x1875816855154944:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1993us (2384us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788918582.692329:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 87 00000100:00100000:3.0:1788918582.716592:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918582.724713:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855155072 00000100:00100000:0.0:1788918582.724737:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855155072 00000100:00100000:0.0:1788918582.724799:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 88 00000100:00100000:0.0:1788918582.724810:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+21:10388:x1875816855155072:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:0.0:1788918582.724873:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac931e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.724889:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac931e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.724914:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac931e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.724951:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac931e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.724959:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac931e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.724967:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac931e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.724972:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918582.724977:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac931e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.724983:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac931e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.724993:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1800) 00010000:00010000:0.0:1788918582.724997:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788918582.725001:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac931e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.725007:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac931e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918582.725106:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+21:10388:x1875816855155072:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 298us (8524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918582.725114:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 88 00000100:00100000:2.0:1788918582.731521:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918582.731550:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855155328 00000100:00100000:2.0:1788918582.731558:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855155328 00000100:00100000:2.0:1788918582.731622:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:2.0:1788918582.731633:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc7198c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+21:10388:x1875816855155328:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:2.0:1788918582.731848:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc7198c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+22:10388:x1875816855155328:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 216us (336us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788918582.731855:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:3.0:1788918582.841149:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918582.841277:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855155584 00000100:00100000:1.0:1788918582.841301:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855155584 00000100:00100000:1.0:1788918582.841374:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00100000:1.0:1788918582.841384:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+22:9907:x1875816855155584:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788918582.841410:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918582.841431:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac9325 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04b8 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918582.841559:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918582.841574:0:5926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9310 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b1 expref: 23 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918582.841584:0:5926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918582.841618:0:5926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b1 expref: 23 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918582.841633:0:5926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b1 expref: 23 pid: 11359 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918582.841648:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865660928:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918582.841785:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe9846840 going to sleep for 11 seconds 00000100:00100000:1.0:1788918582.844848:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865660928:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918582.844882:0:5926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918582.845450:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918582.845541:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855155712 00000100:00100000:0.0:1788918582.845562:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855155712 00010000:00010000:0.0:1788918582.845599:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b1 expref: 24 pid: 11359 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918582.845648:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:0.0:1788918582.845657:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+24:2349:x1875816855155712:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918582.845680:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918582.845687:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b1 expref: 24 pid: 11359 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.845699:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b1 expref: 24 pid: 11359 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.845748:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9310 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b1 expref: 24 pid: 11359 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.845764:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1800) 00010000:00010000:0.0:1788918582.845769:0:5910:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.845777:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.845784:0:5910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.845812:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918582.845864:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+23:2349:x1875816855155712:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 208us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918582.845880:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 48 00010000:00010000:1.0:1788918582.846063:0:5926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918582.846077:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918582.846097:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788918582.846240:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac9325 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b8 expref: 24 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918582.846257:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b8 expref: 23 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918582.846265:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1800) 00010000:00010000:1.0:1788918582.846268:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788918582.846271:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4600, rc 0) 00000100:00100000:1.0:1788918582.846313:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+23:9907:x1875816855155584:12345-192.168.202.49@tcp:101:bash.0 Request processed in 4930us (5175us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788918582.846320:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00100000:3.0:1788918582.849283:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918582.849745:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855155840 00000100:00100000:0.0:1788918582.849757:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855155840 00000100:00100000:0.0:1788918582.849819:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 90 00000100:00100000:0.0:1788918582.849830:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+23:9907:x1875816855155840:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788918582.849860:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918582.849881:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac933a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04bf expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.849915:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9341 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.849929:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.849941:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.850100:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac933a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04bf expref: 25 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.850118:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04bf expref: 24 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.850127:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1800) 00010000:00010000:0.0:1788918582.850130:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788918582.850134:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20a00, rc 0) 00000100:00100000:0.0:1788918582.850194:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+24:9907:x1875816855155840:12345-192.168.202.49@tcp:101:bash.0 Request processed in 366us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918582.850428:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 90 00000100:00100000:2.0:1788918582.856157:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918582.856980:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855156096 00000100:00100000:0.0:1788918582.856991:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855156096 00000100:00100000:0.0:1788918582.857062:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 91 00000100:00100000:0.0:1788918582.857071:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+24:9907:x1875816855156096:12345-192.168.202.49@tcp:36:bash.0 00010000:00010000:0.0:1788918582.857299:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac9348 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.857315:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac9348 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.857326:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac9348 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788918582.857365:0:11359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788918582.857384:0:11359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000591774f0 reply state 000000004d9623a2 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac9348 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918582.857392:0:11359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788918582.857463:0:11359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788918582.857569:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+28:9907:x1875816855156096:12345-192.168.202.49@tcp:36:bash.0 Request processed in 498us (1423us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788918582.857577:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 91 00000020:00080000:0.0:1788918582.857582:0:11359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788918582.862687:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac9348 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.862707:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac9348 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.862725:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac9348 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.862732:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918582.862739:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac9348 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.862747:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac9348 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.862764:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1800) 00010000:00010000:2.0:1788918582.862785:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918582.862792:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac9348 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918582.862799:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20400/0x2811b8b2b0ac9348 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918582.864064:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918582.864266:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855156224 00000100:00100000:0.0:1788918582.864276:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855156224 00000100:00100000:0.0:1788918582.864332:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 92 00000100:00100000:0.0:1788918582.864343:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+27:9907:x1875816855156224:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788918582.864370:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918582.864401:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac934f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04c6 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.864457:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac934f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04c6 expref: 28 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.864471:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac934f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04c6 expref: 28 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918582.864488:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1800) 00010000:00010000:0.0:1788918582.864491:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788918582.864495:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21400, rc 0) 00000100:00100000:0.0:1788918582.864556:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+28:9907:x1875816855156224:12345-192.168.202.49@tcp:101:bash.0 Request processed in 215us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918582.864563:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 92 00000100:00100000:3.0:1788918582.868451:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918582.868726:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855156352 00000100:00100000:1.0:1788918582.868736:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855156352 00000100:00100000:1.0:1788918582.868815:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:1.0:1788918582.868826:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+6:9907:x1875816855156352:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788918582.868843:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1788918582.868846:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788918582.868864:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b861f99/0x2811b8b2b0ac9356 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04cd expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788918582.868889:0:6911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa0bb31, atime: 0x6aa0bb2f, ctime: 0x6aa0bb31, blocks: 0x8 00010000:00010000:1.0:1788918582.868910:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=285s v=(0 0) 00010000:00010000:1.0:1788918582.868929:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918582.868938:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b861f99/0x2811b8b2b0ac9356 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04cd expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918582.868957:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b861f99/0x2811b8b2b0ac9356 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04cd expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918582.868969:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4800, rc 0) 00000100:00100000:1.0:1788918582.869069:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+7:9907:x1875816855156352:12345-192.168.202.49@tcp:101:bash.0 Request processed in 244us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918582.869076:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:3.0:1788918582.878588:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918582.883866:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855156480 00000100:00100000:1.0:1788918582.883883:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855156480 00002000:00010000:1.0:1788918582.883935:0:6915:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788918582.883940:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffefc8c700 with x1875816855156480 ext(0->18446744073709551615) 00002000:00010000:1.0:1788918582.883952:0:6915:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffefc8c700. 00000100:00100000:1.0:1788918582.883996:0:6915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:1.0:1788918582.884006:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b921db9-4859-438b-976e-b950f67eace4+7:2352:x1875816855156480:12345-192.168.202.49@tcp:10:bash.0 00002000:00010000:1.0:1788918582.884317:0:6915:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788918582.884322:0:6915:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788918577 -> 1788918581 00002000:00010000:1.0:1788918582.884325:0:6915:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788918575 -> 1788918575 00002000:00010000:1.0:1788918582.884327:0:6915:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788918577 -> 1788918581 00002000:00010000:1.0:1788918582.884330:0:6915:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788918582.884401:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b921db9-4859-438b-976e-b950f67eace4+8:2352:x1875816855156480:12345-192.168.202.49@tcp:10:bash.0 Request processed in 396us (5824us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788918582.884409:0:6915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 1 00002000:00010000:1.0:1788918582.884423:0:6915:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788918582.884425:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffefc8c700 with x1875816855156480 ext(0->18446744073709551615) 00002000:00010000:1.0:1788918582.884430:0:6915:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffefc8c700. 00000001:00080000:2.0:1788918582.886574:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:2.0:1788918582.886588:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1788918582.940084:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918583.052152:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918583.052533:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855156608 00000100:00100000:0.0:1788918583.052545:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855156608 00000100:00100000:0.0:1788918583.052678:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 93 00000100:00100000:0.0:1788918583.052690:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+28:10402:x1875816855156608:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:0.0:1788918583.052775:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac935d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.052792:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac935d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.052804:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac935d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.052819:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9364 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.052836:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.052843:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.052923:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac936b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.052932:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac936b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.052938:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac936b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788918583.052985:0:11359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac936b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.052996:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac935d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.053002:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac935d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.053009:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac935d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.053016:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918583.054260:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac935d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.054275:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac935d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.054305:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:0.0:1788918583.054307:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918583.054313:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac935d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.054321:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac935d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.054339:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.054346:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9364 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.054352:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.054358:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918583.054360:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.054366:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9364 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.054372:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94fff6819900) 00010000:00010000:0.0:1788918583.054375:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918583.054377:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9364 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.054383:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.054412:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac936b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.055504:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac936b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.055511:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac936b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.055517:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918583.055521:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac936b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.055528:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac936b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.055539:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1800) 00010000:00010000:0.0:1788918583.055541:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918583.055545:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac936b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.055551:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac936b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918583.056274:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+28:10402:x1875816855156608:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 3581us (4127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918583.056285:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 93 00000100:00100000:3.0:1788918583.134651:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918583.134769:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855156864 00000100:00100000:0.0:1788918583.134780:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855156864 00000100:00100000:0.0:1788918583.134852:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 94 00000100:00100000:0.0:1788918583.134879:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+28:10405:x1875816855156864:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918583.134902:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918583.134923:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9372 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04d4 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135003:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9379 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135062:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135075:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135092:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9380 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135099:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135106:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135345:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9387 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135355:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135362:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918583.135382:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788918583.135459:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135467:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9379 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135474:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9379 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135479:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918583.135483:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9379 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135492:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9379 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135503:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:0.0:1788918583.135506:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918583.135510:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9379 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135516:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9379 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135530:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135536:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9380 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135551:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135827:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918583.135830:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135837:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135846:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94fff6819900) 00010000:00010000:0.0:1788918583.135849:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918583.135853:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9380 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135858:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9380 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135903:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9372 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04d4 expref: 31 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135917:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04d4 expref: 30 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.135924:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1800) 00010000:00010000:0.0:1788918583.135926:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788918583.135929:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21e00, rc 0) 00000100:00100000:0.0:1788918583.135994:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+30:10405:x1875816855156864:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1117us (1353us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788918583.136011:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 94 00000100:00100000:3.0:1788918583.143669:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918583.143807:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855156992 00000100:00100000:1.0:1788918583.143817:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855156992 00000100:00100000:1.0:1788918583.143878:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 95 00000100:00100000:1.0:1788918583.143887:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+30:10405:x1875816855156992:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:1.0:1788918583.143978:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.143997:0:5926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b8 expref: 30 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.144007:0:5926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.144067:0:5926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b8 expref: 30 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.144082:0:5926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b8 expref: 30 pid: 5926 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918583.144095:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865661056:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918583.144208:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe9846240 going to sleep for 11 seconds 00000100:00100000:1.0:1788918583.149383:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865661056:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918583.149414:0:5926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918583.157439:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918583.157796:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855157248 00000100:00100000:2.0:1788918583.157808:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855157248 00000100:00100000:2.0:1788918583.157865:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:2.0:1788918583.157876:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+31:5432:x1875816855157248:12345-192.168.202.49@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788918583.158249:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+32:5432:x1875816855157248:12345-192.168.202.49@tcp:35:ldlm_bl.0 Request processed in 372us (818us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788918583.158257:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:2.0:1788918583.163000:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918583.171060:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855157376 00000100:00100000:3.0:1788918583.171076:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855157376 00010000:00010000:3.0:1788918583.171142:0:8796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b8 expref: 32 pid: 5926 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918583.171228:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:3.0:1788918583.171239:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5094c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+32:2349:x1875816855157376:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918583.171256:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918583.171264:0:8796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b8 expref: 32 pid: 5926 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.171278:0:8796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b8 expref: 32 pid: 5926 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.171300:0:8796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac932c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04b8 expref: 32 pid: 5926 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.171319:0:8796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1800) 00010000:00010000:3.0:1788918583.171324:0:8796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.171333:0:8796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.171341:0:8796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.171375:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918583.171436:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5094c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+31:2349:x1875816855157376:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 199us (8446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918583.171445:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 49 00010000:00010000:1.0:1788918583.171847:0:5926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.171856:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.171894:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.171902:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.171908:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.171914:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918583.171919:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.171926:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.171935:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1800) 00010000:00010000:1.0:1788918583.171938:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788918583.171942:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.171949:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9395 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918583.171995:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+30:10405:x1875816855156992:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 28109us (28335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918583.172012:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 95 00000100:00100000:0.0:1788918583.175876:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918583.175970:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855157632 00000100:00100000:2.0:1788918583.175980:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855157632 00000100:00100000:2.0:1788918583.176064:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:2.0:1788918583.176074:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+30:10405:x1875816855157632:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:2.0:1788918583.176444:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+31:10405:x1875816855157632:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 371us (576us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788918583.176452:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:0.0:1788918583.343217:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918583.343446:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855157888 00000100:00100000:3.0:1788918583.343471:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855157888 00000100:00100000:3.0:1788918583.343534:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 96 00000100:00100000:3.0:1788918583.343545:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+31:10416:x1875816855157888:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:3.0:1788918583.343579:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918583.343601:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac939c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04db expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.343680:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.343695:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.343708:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.343732:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.343739:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.343745:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.343856:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac93b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.343865:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac93b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.343873:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac93b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918583.343890:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788918583.343978:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.343986:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.343992:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.343998:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918583.344002:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.344009:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.344056:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:3.0:1788918583.344059:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918583.344064:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.344070:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.344083:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.344089:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.344105:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.344111:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918583.344114:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.344135:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.344145:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94ffe293da00) 00010000:00010000:3.0:1788918583.344147:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918583.344150:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.344156:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.344199:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac939c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04db expref: 34 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.344503:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac93b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04db expref: 33 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.344511:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1800) 00010000:00010000:3.0:1788918583.344513:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788918583.344515:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0031400, rc 0) 00000100:00100000:3.0:1788918583.344596:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+33:10416:x1875816855157888:12345-192.168.202.49@tcp:101:cat.0 Request processed in 1052us (1404us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788918583.344613:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 96 00000100:00100000:0.0:1788918583.350517:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918583.350628:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855158144 00000100:00100000:2.0:1788918583.350638:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855158144 00000100:00100000:2.0:1788918583.350698:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:2.0:1788918583.350708:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+33:10416:x1875816855158144:12345-192.168.202.49@tcp:35:cat.0 00000100:00100000:2.0:1788918583.351004:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+34:10416:x1875816855158144:12345-192.168.202.49@tcp:35:cat.0 Request processed in 295us (497us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788918583.351012:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:1.0:1788918583.400842:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918583.401059:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855158400 00000100:00100000:0.0:1788918583.401069:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855158400 00000100:00100000:0.0:1788918583.401129:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 97 00000100:00100000:0.0:1788918583.401140:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+34:10417:x1875816855158400:12345-192.168.202.49@tcp:36:rm.0 00010000:00010000:0.0:1788918583.401211:0:11359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788918583.401318:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac934f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04c6 expref: 34 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.401343:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac93b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04db expref: 33 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.401358:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9387 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04d4 expref: 32 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.401368:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9341 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04bf expref: 31 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.401377:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94ffff5d1800) 00010000:00010000:0.0:1788918583.401389:0:11359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918583.401411:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac93bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.401426:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac93bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.401450:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac93bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.401465:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac93c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.401472:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac93c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.401478:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac93c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.402840:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac93cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.402863:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac93cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.402875:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac93cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788918583.404830:0:11359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788918583.404846:0:11359:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 285685825422ns, next at 286685821632ns, rc = 0 00010000:00010000:0.0:1788918583.404976:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac93d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.404994:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac93d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405006:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac93d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405054:0:11359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac93d4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405062:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac93d4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405069:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac93d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405103:0:11359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788918583.405128:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac93cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405134:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac93cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405141:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac93cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405145:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918583.405150:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac93cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405158:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac93cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405171:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff6819d00) 00010000:00010000:0.0:1788918583.405174:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788918583.405180:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac93cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405197:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac93cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405223:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac93bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405229:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac93bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405235:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac93bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405240:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918583.405242:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac93bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405249:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac93bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405258:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:0.0:1788918583.405260:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918583.405264:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac93bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.405269:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac93bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788918583.405279:0:11359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0e1a268 reply state 000000005d956766 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac93c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918583.405289:0:11359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788918583.405518:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918583.405527:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac93d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.405533:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20800 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918583.405537:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac93d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.405544:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac93d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.405565:0:5912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94fff6819d00) 00010000:00010000:1.0:1788918583.405569:0:5912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788918583.405573:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac93d4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.405580:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac93d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.405601:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918583.405603:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918583.405605:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918583.405813:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+32:10417:x1875816855158400:12345-192.168.202.49@tcp:36:rm.0 Request processed in 4669us (4979us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788918583.405824:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 97 00010000:00010000:3.0:1788918583.415654:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac93c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.415673:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac93c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.415681:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac93c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.415687:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918583.415692:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac93c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.415701:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac93c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.415728:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94fff6819900) 00010000:00010000:3.0:1788918583.415731:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918583.415736:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac93c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.415742:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac93c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918583.499365:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918583.507246:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855158656 00000100:00100000:3.0:1788918583.507265:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855158656 00000100:00100000:3.0:1788918583.507357:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 98 00000100:00100000:3.0:1788918583.507368:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+31:10423:x1875816855158656:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788918583.507392:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918583.507445:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac93db lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04e2 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.507550:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.507567:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.507580:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.507595:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.507602:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.507608:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788918583.507957:0:5925:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788918583.508159:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac93f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.508169:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac93f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.508177:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac93f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.508213:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.508232:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.508239:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.508245:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918583.508250:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.508257:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.508269:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:3.0:1788918583.508272:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918583.508277:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.508284:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac93e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788918583.508300:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffa2aadb reply state 000000000f82d6a4 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918583.508309:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788918583.508337:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac93db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e2 expref: 34 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.508350:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac93f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e2 expref: 33 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.508367:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d200) 00010000:00010000:3.0:1788918583.508370:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788918583.508372:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0030800, rc 0) 00000100:00100000:3.0:1788918583.508457:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+34:10423:x1875816855158656:12345-192.168.202.49@tcp:101:bash.0 Request processed in 1090us (9104us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788918583.508465:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 98 00010000:00010000:2.0:1788918583.511607:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918583.511630:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918583.511639:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918583.511646:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918583.511652:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918583.511661:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918583.511684:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94ffe293da00) 00010000:00010000:2.0:1788918583.511687:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918583.511694:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918583.511701:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac93e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918583.515625:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918583.519910:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855158784 00000100:00100000:0.0:1788918583.519940:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855158784 00000100:00100000:0.0:1788918583.520108:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:0.0:1788918583.520122:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855158784:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788918583.520160:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918583.520198:0:7258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac93fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04e9 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788918583.520238:0:7258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918583.520268:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788918583.520273:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918583.520288:0:7258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac93fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e9 expref: 6 pid: 7258 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.520315:0:7258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac93fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e9 expref: 6 pid: 7258 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.520332:0:7258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21000, rc 0) 00000100:00100000:0.0:1788918583.520441:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855158784:12345-192.168.202.49@tcp:101:bash.0 Request processed in 321us (4831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918583.520451:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00080000:2.0:1788918583.520602:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918583.528783:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918583.528989:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855158912 00000100:00100000:3.0:1788918583.529003:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855158912 00000100:00100000:3.0:1788918583.529110:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:3.0:1788918583.529134:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+6:10423:x1875816855158912:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788918583.529168:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918583.529194:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04f0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.529241:0:6911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac93fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e9 expref: 7 pid: 7258 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.529251:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918583.529256:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918583.529263:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.529309:0:6911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac93fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e9 expref: 7 pid: 7258 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.529350:0:6911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac93fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e9 expref: 7 pid: 7258 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918583.529367:0:6911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1875816865661184:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918583.529512:0:6911:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a89f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788918583.536973:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918583.537286:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855159040 00000100:00100000:0.0:1788918583.537300:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855159040 00010000:00010000:0.0:1788918583.537356:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac93fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e9 expref: 8 pid: 7258 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918583.537429:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:0.0:1788918583.537441:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+8:2349:x1875816855159040:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918583.537461:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918583.537490:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac93fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e9 expref: 8 pid: 7258 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.537520:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac93fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e9 expref: 8 pid: 7258 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.537553:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918583.537560:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918583.537571:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 8 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.537583:0:5911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 8 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.537635:0:5911:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 8 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918583.537654:0:5911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff84d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5911:1875816865661312:192.168.202.49@tcp:105: 00000100:00100000:0.0:1788918583.538385:0:5911:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc2bca900 going to sleep for 11 seconds 00010000:00010000:3.0:1788918583.539014:0:6911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac93fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e9 expref: 8 pid: 7258 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918583.539075:0:6911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1875816865661184:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918583.539125:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.539143:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0030a00, rc 0) 00000100:00100000:3.0:1788918583.539211:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+7:10423:x1875816855158912:12345-192.168.202.49@tcp:101:bash.0 Request processed in 10081us (10449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918583.539223:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:0.0:1788918583.543414:0:5911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff84d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5911:1875816865661312:192.168.202.49@tcp:105: 00010000:00010000:0.0:1788918583.543519:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918583.543608:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855159040:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 6168us (6649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918583.543624:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:2.0:1788918583.549266:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918583.549440:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855159296 00000100:00100000:0.0:1788918583.549457:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855159296 00000100:00100000:0.0:1788918583.549565:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:0.0:1788918583.549581:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+33:10423:x1875816855159296:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:0.0:1788918583.550098:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+34:10423:x1875816855159296:12345-192.168.202.49@tcp:35:bash.0 Request processed in 517us (844us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788918583.550107:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:1.0:1788918583.793469:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918583.794834:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855159424 00000100:00100000:3.0:1788918583.794853:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855159424 00000100:00100000:3.0:1788918583.794949:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 99 00000100:00100000:3.0:1788918583.794961:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+34:10439:x1875816855159424:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918583.794993:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918583.795070:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac940c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04f7 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.795404:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9413 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.795425:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.795444:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918583.795505:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788918583.795509:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918583.795534:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.795790:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac940c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f7 expref: 36 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.795817:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f7 expref: 35 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.795828:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:3.0:1788918583.795832:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788918583.795837:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0030000, rc 0) 00000100:00100000:3.0:1788918583.795938:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+35:10439:x1875816855159424:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 978us (2486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918583.795947:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 99 00000100:00100000:1.0:1788918583.802771:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918583.803187:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855159680 00000100:00100000:3.0:1788918583.803206:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855159680 00000100:00100000:3.0:1788918583.803283:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00100000:3.0:1788918583.803296:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+35:10439:x1875816855159680:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918583.803331:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918583.803364:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac941a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f04fe expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.803523:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9421 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.803544:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.803576:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918583.803592:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788918583.803885:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac941a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04fe expref: 38 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.803906:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9421 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04fe expref: 37 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.803916:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d200) 00010000:00010000:3.0:1788918583.803920:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788918583.803925:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0031400, rc 0) 00000100:00100000:3.0:1788918583.804011:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+37:10439:x1875816855159680:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 718us (1257us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788918583.804865:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00100000:2.0:1788918583.809681:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918583.811832:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918583.813517:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855160064 00000100:00100000:3.0:1788918583.813587:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855160064 00000100:00100000:3.0:1788918583.813721:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 101 00000100:00100000:3.0:1788918583.813736:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+37:10439:x1875816855160064:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918583.813773:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918583.813807:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac942f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0505 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.814320:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9436 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.814342:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.814364:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918583.814382:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788918583.814534:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac942f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0505 expref: 40 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918583.814561:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855159936 00010000:00010000:3.0:1788918583.814563:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9436 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0505 expref: 39 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.814583:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d200) 00000100:00100000:0.0:1788918583.814584:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855159936 00010000:00010000:3.0:1788918583.814593:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788918583.814599:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4600, rc 0) 00000100:00100000:0.0:1788918583.814674:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:0.0:1788918583.814685:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+40:2352:x1875816855159936:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918583.814701:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918583.814747:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9421 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04fe expref: 40 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.814768:0:7989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d200) 00010000:00010000:0.0:1788918583.814773:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918583.816430:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+39:10439:x1875816855160064:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 2682us (4598us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788918583.816447:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 101 00000100:00100000:0.0:1788918583.817058:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+38:2352:x1875816855159936:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 2331us (7350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918583.817080:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:1.0:1788918583.842355:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918583.843414:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855160192 00000100:00100000:0.0:1788918583.843438:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855160192 00000100:00100000:0.0:1788918583.843575:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:0.0:1788918583.843589:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855160192:12345-192.168.202.49@tcp:1:lfs.0 00010000:00010000:0.0:1788918583.843666:0:7258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.843910:0:7258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 6 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.843922:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788918583.843927:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788918583.843933:0:7258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.843987:0:7258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 6 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.844006:0:7258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 6 pid: 6911 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918583.844152:0:7258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff84d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7258:1875816865661440:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918583.845134:0:7258:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc2bca900 going to sleep for 11 seconds 00000100:00100000:0.0:1788918583.853145:0:7258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff84d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7258:1875816865661440:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918583.853193:0:7258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918583.861742:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918583.863836:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855160320 00000100:00100000:0.0:1788918583.863880:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855160320 00002000:00100000:0.0:1788918583.863961:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff94ffeff68700 x1875816855160320/t0(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:454/0 lens 504/0 e 0 to 0 dl 1788918594 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788918583.863975:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffeff68700 with x1875816855160320 ext(0->8) 00010000:00010000:0.0:1788918583.863987:0:6917:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 7 pid: 6911 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.864009:0:6917:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 7 pid: 6911 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788918583.864075:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94ffeff68700 00000100:00100000:0.0:1788918583.864117:0:6917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:0.0:1788918583.864130:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855160320:12345-192.168.202.49@tcp:4:lfs.0 00000100:00100000:0.0:1788918583.866308:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b921db9-4859-438b-976e-b950f67eace4+9:2349:x1875816855160320:12345-192.168.202.49@tcp:4:lfs.0 Request processed in 2170us (4571us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788918583.866322:0:6917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 1 00002000:00100000:0.0:1788918583.866336:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff94ffeff68700 x1875816855160320/t4294967302(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:454/0 lens 504/448 e 0 to 0 dl 1788918594 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788918583.866344:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffeff68700 with x1875816855160320 ext(0->8) 00010000:00010000:0.0:1788918583.866355:0:6917:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 9 pid: 6911 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.866373:0:6917:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 9 pid: 6911 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788918583.866395:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94ffeff68700 00000100:00100000:1.0:1788918583.889652:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918583.889897:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855160448 00000100:00100000:2.0:1788918583.889911:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855160448 00010000:00010000:2.0:1788918583.889965:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 9 pid: 6911 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918583.890068:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:2.0:1788918583.890082:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+9:2351:x1875816855160448:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918583.890104:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788918583.890132:0:5909:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788918583.890137:0:5909:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788918582 00002000:00010000:2.0:1788918583.890140:0:5909:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788918582 00002000:00010000:2.0:1788918583.890143:0:5909:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788918582 00002000:00010000:2.0:1788918583.890146:0:5909:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788918583.890153:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 9 pid: 6911 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918583.890171:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 9 pid: 6911 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918583.890215:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d214361/0x2811b8b2b0ac9405 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f0 expref: 9 pid: 6911 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918583.890263:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788918583.890269:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788918583.890277:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918583.890289:0:5909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918583.891948:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918583.892074:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+8:2351:x1875816855160448:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 1988us (2431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918583.892089:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 51 00010000:00010000:1.0:1788918583.892717:0:7258:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.892735:0:7258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.892772:0:7258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.892782:0:7258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.892792:0:7258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.892800:0:7258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21800 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918583.892805:0:7258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.892816:0:7258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.892839:0:7258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.892867:0:7258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ff97a76/0x2811b8b2b0ac9444 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918583.892945:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2351:x1875816855160192:12345-192.168.202.49@tcp:1:lfs.0 Request processed in 49358us (50609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918583.892954:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:1.0:1788918583.900741:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918583.901227:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855160704 00000100:00100000:0.0:1788918583.901241:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855160704 00000100:00100000:3.0:1788918583.901454:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:3.0:1788918583.901483:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc7199050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+38:10439:x1875816855160704:12345-192.168.202.49@tcp:35:lfs.0 00000004:00010000:3.0:1788918583.901562:0:5927:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9436 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0505 expref: 38 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788918583.902436:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788918583.902475:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788918583.903409:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788918583.903456:0:5927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.903476:0:5927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac93f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e2 expref: 42 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.903485:0:5927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.903521:0:5927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac93f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e2 expref: 42 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.903538:0:5927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac93f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e2 expref: 42 pid: 5925 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918583.904397:0:5927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5927:1875816865661568:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918583.904618:0:5927:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a89840 going to sleep for 11 seconds 00000100:00100000:0.0:1788918583.921563:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918583.921734:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855160832 00000100:00100000:1.0:1788918583.921744:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855160832 00010000:00010000:1.0:1788918583.921791:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac93f0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e2 expref: 43 pid: 5925 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918583.921844:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:1.0:1788918583.921854:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+43:2349:x1875816855160832:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918583.921870:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918583.921878:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac93f0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e2 expref: 43 pid: 5925 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.921894:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac93f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e2 expref: 43 pid: 5925 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.921917:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d200) 00010000:00010000:1.0:1788918583.921923:0:5911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.921933:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.921952:0:5911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.921974:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918583.922064:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+43:2349:x1875816855160832:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 211us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918583.922072:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 52 00010000:00010000:3.0:1788918583.924626:0:5927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac93f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04e2 expref: 42 pid: 5925 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918583.924653:0:5927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5927:1875816865661568:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918583.924693:0:5927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.924715:0:5927:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.924722:0:5927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788918583.924828:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788918583.924923:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788918583.925007:0:5927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5927:1875816865661696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788918583.925399:0:5927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918583.925453:0:5927:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a89780 going to sleep for 11 seconds 00000100:00100000:0.0:1788918583.925560:0:5929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865661696 00000100:00100000:0.0:1788918583.925568:0:5929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865661696 00000100:00100000:0.0:1788918583.925634:0:5929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788918583.925644:0:5929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5927:x1875816865661696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788918583.925735:0:5929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5927:x1875816865661696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 93us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918583.925743:0:5929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788918583.926068:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918583.926106:0:5927:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788918583.926118:0:5927:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1788918583.926139:0:5927:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94ffc5372d80, transno 4294967301 00000100:00100000:3.0:1788918583.926157:0:5927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5927:1875816865661696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788918583.926593:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788918583.926646:0:5927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff11c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5927:1875816865661824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788918583.926683:0:5927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918583.926716:0:5927:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a89480 going to sleep for 11 seconds 00000100:00100000:0.0:1788918583.926819:0:5929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865661824 00000100:00100000:0.0:1788918583.926825:0:5929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865661824 00000100:00100000:0.0:1788918583.926863:0:5929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788918583.926871:0:5929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5927:x1875816865661824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788918583.926987:0:5929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5927:x1875816865661824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (302us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788918583.926994:0:5929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788918583.927073:0:5927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff11c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5927:1875816865661824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788918583.927132:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788918583.927166:0:5927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.927175:0:5927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.927182:0:5927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.927188:0:5927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918583.927193:0:5927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.927201:0:5927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.927413:0:5927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d200) 00010000:00010000:1.0:1788918583.927416:0:5927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788918583.927422:0:5927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918583.927446:0:5927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac944b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788918583.927542:0:5927:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788918583.927607:0:5927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788918583.927616:0:5927:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 286208595384ns, next at 287208593545ns, rc = 0 00000001:00080000:1.0:1788918583.927623:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788918583.927645:0:5927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d200) 00010000:00010000:1.0:1788918583.927648:0:5927:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788918583.927655:0:5927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9436 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0505 expref: 46 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918583.927764:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc7199050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+45:10439:x1875816855160704:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 26295us (27037us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788918583.927773:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 26 00000020:00080000:1.0:1788918583.927777:0:5927:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788918583.931185:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918583.931490:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855160960 00000100:00100000:3.0:1788918583.931502:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855160960 00000100:00100000:3.0:1788918583.931567:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 102 00000100:00100000:3.0:1788918583.931576:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+45:10439:x1875816855160960:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918583.931597:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918583.931633:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9452 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f050c expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.931692:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9452 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f050c expref: 46 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.931718:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9452 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f050c expref: 46 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918583.931736:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:3.0:1788918583.931739:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788918583.931742:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5800, rc 0) 00000100:00100000:3.0:1788918583.931988:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+46:10439:x1875816855160960:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 411us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918583.931995:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 102 00000100:00100000:0.0:1788918583.947139:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918583.947254:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855161216 00000100:00100000:2.0:1788918583.947266:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855161216 00000100:00100000:2.0:1788918583.947325:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:2.0:1788918583.947336:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+46:10439:x1875816855161216:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:2.0:1788918583.947586:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+47:10439:x1875816855161216:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 250us (456us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788918583.947595:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 27 00010000:00010000:2.0:1788918583.961579:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918584.145389:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918584.145500:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855161344 00000100:00100000:2.0:1788918584.145510:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855161344 00000100:00100000:2.0:1788918584.145605:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 103 00000100:00100000:2.0:1788918584.145616:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+47:10449:x1875816855161344:12345-192.168.202.49@tcp:34:lfs.0 00000100:00080000:3.0:1788918584.145764:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788918584.145919:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9459 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.145939:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.145971:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.145988:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.145996:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.146003:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.146370:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9467 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.146381:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.146389:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788918584.146434:0:11359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.146447:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.146453:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9459 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.146460:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9459 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.146476:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918584.146481:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9459 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.146489:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9459 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.146502:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:2.0:1788918584.146506:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918584.146510:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9459 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.146517:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac9459 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.146531:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.146537:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9460 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.147347:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.147355:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918584.147359:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.147366:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9460 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.147389:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94ffff5d1700) 00010000:00010000:2.0:1788918584.147392:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918584.147396:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9460 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.147402:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.147420:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.147425:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9467 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.147430:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.147434:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dde00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918584.147437:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.147442:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9467 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.147449:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:2.0:1788918584.147451:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918584.147454:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9467 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.147459:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9467 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918584.147560:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+47:10449:x1875816855161344:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 1942us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918584.147569:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 103 00000100:00100000:0.0:1788918584.238169:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918584.238308:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855161600 00000100:00100000:1.0:1788918584.238318:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855161600 00000100:00100000:1.0:1788918584.238374:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 104 00000100:00100000:1.0:1788918584.238383:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+47:10452:x1875816855161600:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788918584.238401:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918584.238421:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac946e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0513 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238492:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9475 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238524:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238536:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238565:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac947c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238573:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac947c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238580:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac947c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238684:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238692:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238699:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918584.238734:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788918584.238814:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238822:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9475 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238829:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9475 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238841:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918584.238846:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9475 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238854:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9475 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238865:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:1.0:1788918584.238868:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918584.238872:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9475 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238878:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9475 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238893:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac947c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238900:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac947c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238906:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac947c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238911:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918584.238913:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac947c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238919:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac947c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238935:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94fff48fcd00) 00010000:00010000:1.0:1788918584.238938:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918584.238941:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac947c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238947:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac947c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238981:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac946e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0513 expref: 50 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.238994:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0513 expref: 49 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.239002:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918584.239004:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788918584.239007:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4400, rc 0) 00000100:00100000:1.0:1788918584.239983:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+49:10452:x1875816855161600:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1595us (1818us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788918584.239993:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 104 00000100:00100000:0.0:1788918584.242475:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918584.242578:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855161728 00000100:00100000:1.0:1788918584.242588:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855161728 00000100:00100000:1.0:1788918584.242656:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 105 00000100:00100000:1.0:1788918584.242666:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+49:10452:x1875816855161728:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:1.0:1788918584.242751:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac9491 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.242771:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac9491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.242793:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac9491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.242846:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac9491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.242854:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac9491 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.242863:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac9491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.242869:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918584.242874:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac9491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.242881:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac9491 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.242893:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918584.242896:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788918584.242901:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac9491 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.242908:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac9491 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918584.242983:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+49:10452:x1875816855161728:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 317us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918584.242991:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 105 00000100:00100000:3.0:1788918584.248811:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918584.248890:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855161984 00000100:00100000:2.0:1788918584.248900:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855161984 00000100:00100000:2.0:1788918584.248988:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:2.0:1788918584.248998:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+49:10452:x1875816855161984:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:2.0:1788918584.249260:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+50:10452:x1875816855161984:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 262us (459us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788918584.249268:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:0.0:1788918584.340440:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918584.340532:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855162240 00000100:00100000:3.0:1788918584.340553:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855162240 00000100:00100000:3.0:1788918584.340637:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 106 00000100:00100000:3.0:1788918584.340650:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+50:10462:x1875816855162240:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788918584.340689:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918584.340693:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788918584.340755:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04f7 expref: 50 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.340780:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:3.0:1788918584.340786:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918584.340821:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9498 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f051a expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.340931:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.340944:0:5925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9483 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0513 expref: 50 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.340952:0:5925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.340984:0:5925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0513 expref: 50 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.340998:0:5925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9483 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0513 expref: 50 pid: 5924 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918584.341011:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff11500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865661952:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918584.341189:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a89f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788918584.347720:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918584.347805:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855162368 00000100:00100000:2.0:1788918584.347812:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855162368 00000100:00100000:3.0:1788918584.347824:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff11500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865661952:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918584.347852:0:5925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.347862:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9483 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0513 expref: 51 pid: 5924 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918584.347901:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:2.0:1788918584.347910:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+51:2350:x1875816855162368:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918584.347925:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918584.347931:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9483 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0513 expref: 51 pid: 5924 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.347943:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0513 expref: 51 pid: 5924 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.347963:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0513 expref: 51 pid: 5924 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.347996:0:7989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:2.0:1788918584.348000:0:7989:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.348009:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.348017:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.348083:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918584.348131:0:5925:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918584.348139:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918584.348149:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+50:2350:x1875816855162368:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 241us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918584.348155:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 53 00000004:00200000:0.0:1788918584.348158:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788918584.349138:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9498 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f051a expref: 51 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918584.349160:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f051a expref: 50 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918584.349168:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:0.0:1788918584.349171:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788918584.349173:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4a00, rc 0) 00000100:00100000:0.0:1788918584.349407:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+50:10462:x1875816855162240:12345-192.168.202.49@tcp:101:bash.0 Request processed in 8759us (8976us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788918584.349415:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 106 00000100:00100000:0.0:1788918584.359628:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918584.359735:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855162496 00000100:00100000:1.0:1788918584.359762:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855162496 00000100:00100000:1.0:1788918584.359830:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 107 00000100:00100000:1.0:1788918584.359841:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+50:10462:x1875816855162496:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788918584.359864:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918584.359885:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac94ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0521 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.359922:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac94b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.359938:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac94b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.359950:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac94b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.360102:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac94ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0521 expref: 52 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.360122:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac94b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0521 expref: 51 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.360131:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918584.360133:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788918584.360136:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4200, rc 0) 00000100:00100000:1.0:1788918584.360185:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+51:10462:x1875816855162496:12345-192.168.202.49@tcp:101:bash.0 Request processed in 346us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918584.360191:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 107 00000100:00100000:3.0:1788918584.362867:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918584.365376:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855162752 00000100:00100000:1.0:1788918584.365407:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855162752 00000100:00100000:1.0:1788918584.365479:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 108 00000100:00100000:1.0:1788918584.365489:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+51:10462:x1875816855162752:12345-192.168.202.49@tcp:36:bash.0 00010000:00010000:1.0:1788918584.365742:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac94bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.365760:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac94bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.365772:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac94bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788918584.365811:0:5924:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788918584.365832:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac703dea reply state 00000000ad6d0a08 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac94bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918584.365840:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788918584.365941:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+54:10462:x1875816855162752:12345-192.168.202.49@tcp:36:bash.0 Request processed in 452us (3083us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788918584.365948:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 108 00000020:00080000:1.0:1788918584.365953:0:5924:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788918584.369519:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac94bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.369539:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac94bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.369724:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac94bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.369730:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918584.369735:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac94bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.369744:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac94bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.369762:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:3.0:1788918584.369765:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918584.369769:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac94bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.369776:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac94bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918584.369900:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918584.370078:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855162880 00000100:00100000:1.0:1788918584.370089:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855162880 00000100:00100000:1.0:1788918584.370146:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 109 00000100:00100000:1.0:1788918584.370156:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+53:10462:x1875816855162880:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788918584.370179:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918584.370210:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac94c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0528 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.370298:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.370318:0:5926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f051a expref: 54 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.370329:0:5926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.370364:0:5926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f051a expref: 54 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.370378:0:5926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f051a expref: 54 pid: 5925 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918584.370392:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865662080:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918584.370481:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe98460c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918584.373885:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865662080:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918584.373918:0:5926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918584.374923:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918584.375054:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855163008 00000100:00100000:1.0:1788918584.375063:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855163008 00010000:00010000:1.0:1788918584.375103:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f051a expref: 55 pid: 5925 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918584.375158:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 54 00000100:00100000:1.0:1788918584.375167:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+55:2350:x1875816855163008:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918584.375183:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918584.375331:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f051a expref: 55 pid: 5925 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.375345:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f051a expref: 55 pid: 5925 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.375367:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac949f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f051a expref: 55 pid: 5925 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.375387:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918584.375392:0:5909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.375401:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.375408:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.375443:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918584.375489:0:5926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.375498:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918584.375501:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+54:2350:x1875816855163008:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 335us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918584.375509:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 54 00000004:00200000:3.0:1788918584.375571:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788918584.375576:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918584.375599:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.375632:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac94c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0528 expref: 55 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.375672:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0528 expref: 54 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.375681:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:3.0:1788918584.375684:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788918584.375687:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5400, rc 0) 00000100:00100000:3.0:1788918584.375725:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+54:10462:x1875816855162880:12345-192.168.202.49@tcp:101:bash.0 Request processed in 5571us (5830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918584.375732:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 109 00000100:00100000:0.0:1788918584.379015:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918584.379569:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855163264 00000100:00100000:1.0:1788918584.379581:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855163264 00000100:00100000:1.0:1788918584.379645:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:1.0:1788918584.379657:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+53:10462:x1875816855163264:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:1.0:1788918584.379920:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+54:10462:x1875816855163264:12345-192.168.202.49@tcp:35:bash.0 Request processed in 265us (914us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788918584.379947:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:0.0:1788918584.475188:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918584.475300:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855163392 00000100:00100000:1.0:1788918584.475311:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855163392 00000100:00100000:1.0:1788918584.475377:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 110 00000100:00100000:1.0:1788918584.475388:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+54:10468:x1875816855163392:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788918584.475426:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918584.475448:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac94d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f052f expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.475531:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac94d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.475553:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac94d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.475566:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac94d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918584.475625:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788918584.475630:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788918584.475650:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac94d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.475678:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac94d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f052f expref: 56 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.475710:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac94d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f052f expref: 55 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.475740:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:1.0:1788918584.475743:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788918584.475747:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4e00, rc 0) 00000100:00100000:1.0:1788918584.475809:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+55:10468:x1875816855163392:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 423us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918584.475817:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 110 00000100:00100000:0.0:1788918584.480061:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918584.480125:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855163520 00000100:00100000:2.0:1788918584.480137:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855163520 00000100:00100000:2.0:1788918584.480195:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 111 00000100:00100000:2.0:1788918584.480215:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+55:10468:x1875816855163520:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788918584.480235:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918584.480254:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac94de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0536 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480314:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac94e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480328:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac94e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480339:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac94e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480370:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac94ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480377:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac94ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480384:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac94ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480458:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480467:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480474:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918584.480514:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788918584.480518:0:11359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918584.480536:0:11359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480548:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480557:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac94e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480563:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac94e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480581:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac94e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480587:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918584.480592:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac94e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480600:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac94e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480612:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:2.0:1788918584.480615:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918584.480620:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac94e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480626:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac94e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480639:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac94ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480645:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac94ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480650:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac94ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480654:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dce00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918584.480656:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac94ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480672:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac94ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480680:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94ffff5d1700) 00010000:00010000:2.0:1788918584.480682:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918584.480685:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac94ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480691:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac94ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480734:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac94de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0536 expref: 57 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480746:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0536 expref: 56 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.480753:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:2.0:1788918584.480755:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918584.480758:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd000, rc 0) 00000100:00100000:2.0:1788918584.480819:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+56:10468:x1875816855163520:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 606us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918584.480827:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 111 00000100:00100000:0.0:1788918584.492473:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918584.492814:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855163776 00000100:00100000:1.0:1788918584.492824:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855163776 00000100:00100000:1.0:1788918584.492891:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 112 00000100:00100000:1.0:1788918584.492901:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+56:10468:x1875816855163776:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788918584.492922:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918584.492943:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac94fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f053d expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.493084:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.493100:0:5924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0528 expref: 57 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.493279:0:5924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0536 expref: 57 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.493290:0:5924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918584.493408:0:5924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0536 expref: 57 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918584.493438:0:5924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0536 expref: 57 pid: 11359 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918584.493454:0:5924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff885500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865662208:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918584.493592:0:5924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0528 expref: 57 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918584.493601:0:5924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0528 expref: 57 pid: 5926 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918584.493609:0:5924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff887800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865662336:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918584.493634:0:5924:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc2bca900 going to sleep for 11 seconds 00000100:00100000:0.0:1788918584.502770:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918584.502890:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855163904 00000100:00100000:2.0:1788918584.502900:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855163904 00010000:00010000:2.0:1788918584.502939:0:8796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0536 expref: 58 pid: 11359 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918584.503011:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:2.0:1788918584.503063:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5095050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+58:2350:x1875816855163904:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918584.503079:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918584.503087:0:8796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0536 expref: 58 pid: 11359 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.503101:0:8796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0536 expref: 58 pid: 11359 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.503124:0:8796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:2.0:1788918584.503129:0:8796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.503140:0:8796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.503148:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918584.503204:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5095050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+58:2350:x1875816855163904:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 183us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918584.503212:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 55 00010000:00010000:1.0:1788918584.507811:0:5924:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.49@tcp) returned -22 from blocking AST (req@0000000091811812 x1875816865662208) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0536 expref: 57 pid: 11359 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.507856:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac94f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0536 expref: 57 pid: 11359 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918584.507875:0:5924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff885500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865662208:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918584.507895:0:5924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff887800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865662336:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918584.507920:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918584.507925:0:5924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.507934:0:5924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.507944:0:5924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918584.517364:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918584.517420:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855164032 00000100:00100000:1.0:1788918584.517432:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855164032 00010000:00010000:0.0:1788918584.517519:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0528 expref: 57 pid: 5926 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918584.517564:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00100000:0.0:1788918584.517574:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff884380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+57:2349:x1875816855164032:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918584.517591:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918584.517599:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0528 expref: 57 pid: 5926 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918584.517613:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0528 expref: 57 pid: 5926 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918584.517651:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac94c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0528 expref: 57 pid: 5926 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918584.517668:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:0.0:1788918584.517673:0:5910:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918584.517683:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918584.517692:0:5910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918584.517741:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918584.517795:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff884380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+56:2349:x1875816855164032:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 222us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918584.517803:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 56 00010000:00010000:2.0:1788918584.517878:0:5924:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.517887:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918584.517905:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788918584.518053:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0ac94fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f053d expref: 57 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.518068:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f053d expref: 56 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918584.518076:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:2.0:1788918584.518079:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788918584.518081:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5e00, rc 0) 00000100:00100000:2.0:1788918584.518105:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+56:10468:x1875816855163776:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 25206us (25642us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788918584.518111:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 112 00000100:00100000:0.0:1788918584.529116:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918584.529305:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855164288 00000100:00100000:1.0:1788918584.529316:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855164288 00000100:00100000:1.0:1788918584.529391:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:1.0:1788918584.529401:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff886300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+56:10468:x1875816855164288:12345-192.168.202.49@tcp:103:lfs.0 00010000:00010000:1.0:1788918584.529427:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918584.529451:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9452 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f050c expref: 56 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.529469:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918584.529489:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918584.529552:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff886300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+55:10468:x1875816855164288:12345-192.168.202.49@tcp:103:lfs.0 Request processed in 152us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918584.529560:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:3.0:1788918584.539429:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918584.539676:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855164416 00000100:00100000:1.0:1788918584.539687:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855164416 00000100:00100000:1.0:1788918584.539773:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 113 00000100:00100000:1.0:1788918584.539785:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+55:10468:x1875816855164416:12345-192.168.202.49@tcp:58:lfs.0 00010000:00010000:1.0:1788918584.539924:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac950f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.539942:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac950f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918584.539955:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac950f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788918584.540098:0:5926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788918584.540177:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+55:10468:x1875816855164416:12345-192.168.202.49@tcp:58:lfs.0 Request processed in 394us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918584.540185:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 113 00000100:00100000:0.0:1788918584.545085:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918584.545195:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855164544 00000100:00100000:3.0:1788918584.545213:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855164544 00000100:00100000:3.0:1788918584.545276:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 114 00000100:00100000:3.0:1788918584.545286:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+55:10468:x1875816855164544:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918584.545306:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918584.545327:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9516 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0544 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.545382:0:5925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac950f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.545394:0:5925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9516 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0544 expref: 56 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.545425:0:5925:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac950f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.545460:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9516 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0544 expref: 56 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.545475:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:3.0:1788918584.545478:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788918584.545482:0:5925:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9516 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0544 expref: 56 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918584.545489:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5a00, rc 0) 00000100:00100000:3.0:1788918584.546312:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+56:10468:x1875816855164544:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1024us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918584.546323:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 114 00000100:00100000:2.0:1788918584.923411:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865662720:0@lo:400:kworker.0 00000100:00100000:2.0:1788918584.923497:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918584.923603:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788918584.923610:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865662848:0@lo:400:kworker.0 00000100:00100000:2.0:1788918584.923640:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918584.923675:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865662720 00000100:00100000:2.0:1788918584.923684:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865662720 00000100:00100000:2.0:1788918584.923760:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788918584.923773:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865663232:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788918584.923782:0:8366:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 287204760492ns, next at 288204757597ns, rc = 0 00000100:00100000:2.0:1788918584.923800:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918584.923826:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865662720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918584.923876:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865662720:12345-0@lo:400:kworker.0 Request processed in 107us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918584.923883:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788918584.923920:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865662720:0@lo:400:kworker.0 00000100:00100000:3.0:1788918584.923982:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865662464:0@lo:400:kworker.0 00000100:00100000:3.0:1788918584.924015:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918584.924073:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865662976:0@lo:400:kworker.0 00000100:00100000:3.0:1788918584.924093:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918584.924111:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788918584.924116:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865662592:0@lo:400:kworker.0 00000100:00100000:3.0:1788918584.924136:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918584.924151:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865663104:0@lo:400:kworker.0 00000100:00100000:3.0:1788918584.924169:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788918584.924190:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918584.924215:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865662976 00000100:00100000:3.0:1788918584.924217:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865663232 00000100:00100000:2.0:1788918584.924219:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865662976 00000100:00100000:3.0:1788918584.924220:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865663232 00000100:00100000:2.0:1788918584.924242:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865662592 00000100:00100000:2.0:1788918584.924245:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865662592 00000100:00100000:3.0:1788918584.924251:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788918584.924258:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788918584.924263:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3419:x1875816865663232:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918584.924263:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865662976:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788918584.924289:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125952 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918584.924293:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865662976:12345-0@lo:400:kworker.0 Request processed in 31us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918584.924299:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788918584.924309:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788918584.924315:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865662592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918584.924320:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3419:x1875816865663232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918584.924326:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788918584.924337:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865662592:12345-0@lo:400:kworker.0 Request processed in 23us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918584.924343:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788918584.924344:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788918584.924347:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918584.924362:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865662592:0@lo:400:kworker.0 00000100:00100000:2.0:1788918584.924369:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865662848 00000100:00100000:3.0:1788918584.924371:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865662976:0@lo:400:kworker.0 00000100:00100000:2.0:1788918584.924371:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865662848 00000100:00100000:2.0:1788918584.924394:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865663104 00000100:00100000:2.0:1788918584.924397:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865663104 00000100:00100000:3.0:1788918584.924398:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865663232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918584.924410:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788918584.924416:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3419:x1875816865662848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918584.924429:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788918584.924435:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3417:x1875816865663104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918584.924448:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3419:x1875816865662848:12345-0@lo:400:kworker.0 Request processed in 33us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918584.924455:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788918584.924463:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3417:x1875816865663104:12345-0@lo:400:kworker.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918584.924469:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788918584.924476:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865662848:0@lo:400:kworker.0 00000100:00100000:3.0:1788918584.924488:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865663104:0@lo:400:kworker.0 00000100:00100000:1.0:1788918584.924666:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865662464 00000100:00100000:1.0:1788918584.924670:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865662464 00000100:00100000:1.0:1788918584.924717:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788918584.924724:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865662464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918584.924768:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865662464:12345-0@lo:400:kworker.0 Request processed in 45us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918584.924785:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788918584.925528:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865662464:0@lo:400:kworker.0 00010000:00010000:1.0:1788918584.989351:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788918585.441251:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:3.0:1788918585.441276:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000004:00080000:3.0:1788918585.441294:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788918585.441320:0:5903:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94ffd0a89780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788918585.441326:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94ffc30f4600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94ffd0a89600 00000020:00080000:3.0:1788918585.441329:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94ffc30f4200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94ffeff5de00 00000004:00080000:3.0:1788918585.441353:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788918585.441391:0:5903:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94ffcb2aff00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788918585.441394:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94fff68a9d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94ffcb2afe40 00000020:00080000:3.0:1788918585.441397:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94fff68a9500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94ffff865600 00000020:00080000:3.0:1788918585.441415:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788918585.441496:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788918585.441938:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788918585.441961:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865663360:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788918585.442076:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918585.442236:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865663360 00000100:00100000:1.0:1788918585.442244:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865663360 00000100:00100000:1.0:1788918585.442314:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788918585.442325:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff4ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3419:x1875816865663360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788918585.442352:0:6911:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1788918585.442387:0:6911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa0bb36, atime: 0x6aa0bb36, ctime: 0x6aa0bb36, blocks: 0x8 00010000:00010000:1.0:1788918585.442394:0:6911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5668be4/0x2811b8b2b0ac951d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.442411:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=287s v=(0 0) 00010000:00010000:1.0:1788918585.442415:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918585.442422:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5668be4/0x2811b8b2b0ac951d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.442438:0:6911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5668be4/0x2811b8b2b0ac951d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.442449:0:6911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5668be4/0x2811b8b2b0ac951d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.442457:0:6911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5668be4/0x2811b8b2b0ac951d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.442474:0:6911:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788918585.442812:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff4ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3419:x1875816865663360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 488us (734us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788918585.442820:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788918585.443191:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788918585.443207:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865663488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788918585.443254:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918585.443884:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865663488 00000100:00100000:1.0:1788918585.443894:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865663488 00000100:00100000:1.0:1788918585.443935:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788918585.443944:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3418:x1875816865663488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788918585.443965:0:7258:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1788918585.443988:0:7258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.444009:0:7258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b861f99/0x2811b8b2b0ac9356 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04cd expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.444047:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788918585.444052:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788918585.444057:0:7258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.444089:0:7258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b861f99/0x2811b8b2b0ac9356 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04cd expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.444104:0:7258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b861f99/0x2811b8b2b0ac9356 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04cd expref: 7 pid: 6911 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918585.444117:0:7258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7258:1875816865663616:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918585.444193:0:7258:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe9846480 going to sleep for 11 seconds 00010000:00010000:2.0:1788918585.444676:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918585.444685:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5668be4/0x2811b8b2b0ac951d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.444705:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5a00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918585.444711:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5668be4/0x2811b8b2b0ac951d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.444721:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5668be4/0x2811b8b2b0ac951d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.444746:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5668be4/0x2811b8b2b0ac951d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.444753:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5668be4/0x2811b8b2b0ac951d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.444776:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918585.444779:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918585.444781:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788918585.444792:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788918585.444840:0:3419:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94ffeff69f80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788918585.444848:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865663360:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788918585.446005:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1788918585.446017:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1788918585.458450:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918585.458573:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855164672 00000100:00100000:2.0:1788918585.458581:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855164672 00010000:00010000:2.0:1788918585.458640:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b861f99/0x2811b8b2b0ac9356 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04cd expref: 6 pid: 6911 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918585.458714:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:2.0:1788918585.458724:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855164672:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918585.458751:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918585.458757:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b861f99/0x2811b8b2b0ac9356 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04cd expref: 6 pid: 6911 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.458772:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b861f99/0x2811b8b2b0ac9356 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04cd expref: 6 pid: 6911 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.458801:0:7989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788918585.458807:0:7989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788918585.458812:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.458822:0:7989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.458843:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918585.458903:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff884a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855164672:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 180us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918585.458910:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00080000:3.0:1788918585.459786:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788918585.459953:0:7258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b861f99/0x2811b8b2b0ac9356 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.49@tcp remote: 0x797745954e8f04cd expref: 5 pid: 6911 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918585.459974:0:7258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7258:1875816865663616:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918585.459998:0:7258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.460009:0:7258:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.460017:0:7258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.460080:0:7258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.460089:0:7258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.460114:0:7258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788918585.460832:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3418:x1875816865663488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16886us (17573us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788918585.460842:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788918585.461399:0:3418:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788918585.461406:0:3418:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:0.0:1788918585.461427:0:3418:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94ffff886d80 x1875816865663488/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788918601 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788918585.461458:0:3418:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94ffff886d80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788918585.461464:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865663488:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788918585.461664:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918585.461674:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.461708:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5600 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918585.461713:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.461723:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.464398:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.464410:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081227518/0x2811b8b2b0ac9524 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.464449:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918585.464452:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918585.464454:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788918585.494610:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788918585.494619:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788918585.494670:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788918585.494681:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788918585.494835:0:12048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff887100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12048:1875816865663744:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788918585.494965:0:12048:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc2bca900 going to sleep for 11 seconds 00000100:00100000:2.0:1788918585.510557:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918585.511300:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855164800 00000100:00100000:3.0:1788918585.511315:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855164800 00000100:00100000:3.0:1788918585.511391:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 115 00000100:00100000:3.0:1788918585.511403:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+15:10469:x1875816855164800:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788918585.511441:0:11359:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788918585.511584:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+15:10469:x1875816855164800:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 184us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918585.511592:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 115 00000100:00100000:1.0:1788918585.513183:0:12048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff887100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12048:1875816865663744:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788918585.528491:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918585.528547:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918585.528583:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918585.528645:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918585.528743:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855164928 00000100:00100000:2.0:1788918585.528753:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855164928 00000100:00100000:2.0:1788918585.528813:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 286 00000100:00100000:2.0:1788918585.528822:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2350:x1875816855164928:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918585.528890:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2350:x1875816855164928:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 70us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918585.528897:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 286 00000100:00100000:1.0:1788918585.529493:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855165056 00000100:00100000:1.0:1788918585.529499:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855165056 00000100:00100000:1.0:1788918585.529574:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:1.0:1788918585.529582:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855165056:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918585.529626:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855165056:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 44us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918585.529633:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:1.0:1788918585.529654:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855165312 00000100:00100000:1.0:1788918585.529668:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855165312 00000100:00100000:1.0:1788918585.529704:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855165184 00000100:00100000:1.0:1788918585.529708:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855165184 00000100:00100000:1.0:1788918585.529735:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 139 00000100:00100000:1.0:1788918585.529742:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2350:x1875816855165184:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918585.529769:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2350:x1875816855165184:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 28us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918585.529775:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 139 00000100:00100000:1.0:1788918585.529787:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 116 00000100:00100000:1.0:1788918585.529793:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+14:10469:x1875816855165312:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788918585.529855:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac952b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.529875:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac952b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.529889:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac952b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.529944:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9532 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.529962:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9532 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.529969:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9532 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.529992:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9539 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.530000:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.530005:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918585.530083:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788918585.530088:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788918585.530101:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.530112:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac952b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.530118:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac952b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.530125:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac952b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.530131:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918585.530135:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac952b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.530149:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac952b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.530160:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94fffbdf3600) 00010000:00010000:1.0:1788918585.530163:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918585.530167:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac952b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.530187:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac952b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.530199:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9532 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.530204:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9532 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788918585.530911:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788918585.530926:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788918585.531482:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9532 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.531493:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918585.531496:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9532 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.531505:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9532 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.531518:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff94fff48fc200) 00010000:00010000:1.0:1788918585.531522:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918585.531526:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9532 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.531556:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac9532 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.531579:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.531585:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9539 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.531590:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.531595:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918585.531598:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.531603:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9539 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.531611:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918585.531614:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918585.531617:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9539 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.531622:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9539 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918585.532947:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+14:10469:x1875816855165312:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 Request processed in 3143us (4456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918585.532959:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 116 00000100:00100000:2.0:1788918585.557335:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918585.557483:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855165568 00000100:00100000:0.0:1788918585.557493:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855165568 00000100:00100000:0.0:1788918585.557553:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 117 00000100:00100000:0.0:1788918585.557564:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+14:10469:x1875816855165568:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788918585.557584:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918585.557604:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9540 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f054b expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.557742:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac9547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.557759:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac9547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.557771:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac9547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918585.557796:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788918585.557880:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac9547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.557887:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac9547 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.557893:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac9547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.557898:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918585.557902:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac9547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.557910:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac9547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.557922:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:0.0:1788918585.557925:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788918585.557930:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac9547 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.557936:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac9547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.557977:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9540 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f054b expref: 16 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.557986:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94fffbdf3600) 00010000:00010000:0.0:1788918585.557988:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788918585.557998:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9540 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f054b expref: 16 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.558008:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21c00, rc 0) 00000100:00100000:0.0:1788918585.558088:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+15:10469:x1875816855165568:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 526us (763us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788918585.558096:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 117 00000100:00100000:0.0:1788918585.569598:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918585.569726:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855165696 00000100:00100000:3.0:1788918585.569746:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855165696 00000100:00100000:3.0:1788918585.569799:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 118 00000100:00100000:3.0:1788918585.569810:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+15:10469:x1875816855165696:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788918585.569841:0:5925:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788918585.569953:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+15:10469:x1875816855165696:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 145us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918585.569962:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 118 00000100:00100000:1.0:1788918585.583273:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918585.583350:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855165952 00000100:00100000:0.0:1788918585.583364:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855165952 00000100:00100000:0.0:1788918585.583431:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 119 00000100:00100000:0.0:1788918585.583443:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+15:10469:x1875816855165952:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788918585.583469:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918585.583473:0:11359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788918585.583502:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac94d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f052f expref: 15 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.583523:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:0.0:1788918585.583528:0:11359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918585.583542:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9555 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0552 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788918585.583957:0:11359:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788918585.584201:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac955c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.584902:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac955c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.584932:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac955c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.594618:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9555 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0552 expref: 17 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.594650:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac955c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0552 expref: 16 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.594659:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94fff6819300) 00010000:00010000:2.0:1788918585.594662:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918585.594666:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20800, rc 0) 00000100:00100000:2.0:1788918585.594759:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+16:10469:x1875816855165952:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 11317us (11494us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788918585.594768:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 119 00000100:00100000:2.0:1788918585.611467:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918585.611667:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855166208 00000100:00100000:3.0:1788918585.611677:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855166208 00000100:00100000:3.0:1788918585.611780:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00100000:3.0:1788918585.611791:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+16:10469:x1875816855166208:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788918585.611871:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918585.611897:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac955c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0552 expref: 16 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.611917:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94fff6819300) 00010000:00010000:3.0:1788918585.611928:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918585.611950:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac956a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.611963:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac956a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.611973:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac956a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612087:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9571 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5af16f61 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612096:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5af16f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612103:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5af16f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612147:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac956a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612154:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac956a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612161:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac956a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612173:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918585.612178:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac956a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612186:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac956a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612196:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:3.0:1788918585.612199:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918585.612203:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac956a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612208:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac956a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612218:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5af16f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612224:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9571 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5af16f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612229:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5af16f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612234:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918585.612237:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5af16f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612242:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9571 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5af16f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612259:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5af16f61 (ffff94fff4b4e000) 00010000:00010000:3.0:1788918585.612261:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918585.612264:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9571 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5af16f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.612269:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac9571 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5af16f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918585.612347:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+15:10469:x1875816855166208:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 558us (890us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788918585.612355:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00100000:0.0:1788918585.622782:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918585.623385:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855166336 00000100:00100000:2.0:1788918585.623396:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855166336 00000100:00100000:2.0:1788918585.623461:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 121 00000100:00100000:2.0:1788918585.623472:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+15:10469:x1875816855166336:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788918585.623493:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918585.623527:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9578 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0559 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.623563:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac957f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.623577:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac957f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.623615:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac957f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.623734:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9578 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0559 expref: 17 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.623754:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac957f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0559 expref: 16 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.623764:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94ffff5d1900) 00010000:00010000:2.0:1788918585.623767:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788918585.623771:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd800, rc 0) 00000100:00100000:2.0:1788918585.623843:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+16:10469:x1875816855166336:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 374us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918585.623851:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 121 00000100:00100000:1.0:1788918585.628224:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918585.628400:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855166592 00000100:00100000:2.0:1788918585.628411:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855166592 00000100:00100000:2.0:1788918585.628479:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 122 00000100:00100000:2.0:1788918585.628489:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+16:10469:x1875816855166592:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788918585.628587:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9586 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.628607:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.628621:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788918585.628832:0:5926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1788918585.628887:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fddb49f0 reply state 0000000077616f3a transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918585.628896:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788918585.629015:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+18:10469:x1875816855166592:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 527us (810us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788918585.630315:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 122 00010000:00010000:2.0:1788918585.632840:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.632858:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9586 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.632865:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.632871:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918585.632876:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.632885:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9586 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.632903:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94ffff5d1900) 00010000:00010000:2.0:1788918585.632906:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788918585.632911:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9586 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.632918:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9586 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918585.635717:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918585.636343:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855166720 00000100:00100000:2.0:1788918585.636354:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855166720 00000100:00100000:2.0:1788918585.636404:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 123 00000100:00100000:2.0:1788918585.636413:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+17:10469:x1875816855166720:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788918585.636435:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918585.636456:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac958d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0560 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.636523:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac958d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0560 expref: 18 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.636539:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac958d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0560 expref: 18 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.636558:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94ffff5d1900) 00010000:00010000:2.0:1788918585.636562:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788918585.636565:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd600, rc 0) 00000100:00100000:2.0:1788918585.636631:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+18:10469:x1875816855166720:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 219us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918585.636638:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 123 00000100:00100000:3.0:1788918585.645449:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918585.645625:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855166848 00000100:00100000:0.0:1788918585.645636:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855166848 00000100:00100000:0.0:1788918585.645715:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:0.0:1788918585.645726:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2350:x1875816855166848:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788918585.646014:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2350:x1875816855166848:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 289us (573us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788918585.646066:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:1.0:1788918585.657805:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918585.657895:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855167104 00000100:00100000:3.0:1788918585.657907:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855167104 00000100:00100000:3.0:1788918585.657977:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:3.0:1788918585.657988:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+18:10469:x1875816855167104:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788918585.658268:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+19:10469:x1875816855167104:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 281us (474us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788918585.658276:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:2.0:1788918585.677756:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918585.677992:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855167360 00000100:00100000:3.0:1788918585.678002:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855167360 00000100:00100000:3.0:1788918585.678111:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 124 00000100:00100000:3.0:1788918585.678121:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+19:10469:x1875816855167360:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788918585.678254:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+19:10469:x1875816855167360:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 134us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918585.678262:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 124 00000100:00100000:0.0:1788918585.682275:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918585.682354:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855167488 00000100:00100000:2.0:1788918585.682364:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855167488 00000100:00100000:2.0:1788918585.682422:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 125 00000100:00100000:2.0:1788918585.682433:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+19:10469:x1875816855167488:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788918585.682453:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918585.682487:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9594 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0567 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.682567:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac959b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.682582:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac959b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.682594:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac959b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918585.682640:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918585.682658:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac959b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.682685:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9594 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0567 expref: 21 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.682714:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac959b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0567 expref: 20 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.682724:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94ffff5d1900) 00010000:00010000:2.0:1788918585.682900:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788918585.682907:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dce00, rc 0) 00000100:00100000:2.0:1788918585.682976:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+20:10469:x1875816855167488:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 544us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918585.682983:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 125 00000100:00100000:1.0:1788918585.692008:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918585.699650:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855167616 00000100:00100000:2.0:1788918585.699669:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855167616 00000100:00100000:2.0:1788918585.699801:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:2.0:1788918585.699812:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855167616:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788918585.699830:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918585.699849:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e2823ea/0x2811b8b2b0ac95a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f056e expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788918585.699875:0:6911:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0bb38, blocks: 0x0 00010000:00010000:2.0:1788918585.699897:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788918585.699902:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918585.699912:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e2823ea/0x2811b8b2b0ac95a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f056e expref: 7 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.699930:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e2823ea/0x2811b8b2b0ac95a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f056e expref: 7 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.699945:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dc400, rc 0) 00000100:00100000:2.0:1788918585.700039:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+7:2351:x1875816855167616:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 208us (8020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918585.700048:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:1.0:1788918585.708073:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918585.708164:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855167872 00000100:00100000:3.0:1788918585.708174:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855167872 00000100:00100000:3.0:1788918585.708234:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 126 00000100:00100000:3.0:1788918585.708244:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+20:10469:x1875816855167872:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788918585.708353:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+20:10469:x1875816855167872:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 111us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918585.708360:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 126 00000100:00100000:3.0:1788918585.711900:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918585.712016:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855168000 00000100:00100000:0.0:1788918585.712068:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855168000 00000100:00100000:0.0:1788918585.712119:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:0.0:1788918585.712128:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+7:10469:x1875816855168000:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788918585.712147:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918585.712167:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac95a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0575 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.712197:0:6909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e2823ea/0x2811b8b2b0ac95a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f056e expref: 8 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.712206:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918585.712210:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918585.712231:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac95a9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0575 expref: 8 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.712267:0:6909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e2823ea/0x2811b8b2b0ac95a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f056e expref: 8 pid: 6911 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.712281:0:6909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e2823ea/0x2811b8b2b0ac95a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f056e expref: 8 pid: 6911 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918585.712295:0:6909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff885880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6909:1875816865663872:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918585.712397:0:6909:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918585.721008:0:6909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff885880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6909:1875816865663872:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918585.721083:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac95a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0575 expref: 8 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.721116:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21e00, rc 0) 00000100:00100000:0.0:1788918585.721181:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+8:10469:x1875816855168000:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 9053us (9289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918585.721190:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:2.0:1788918585.722126:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918585.722241:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855168128 00000100:00100000:0.0:1788918585.722249:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855168128 00010000:00010000:0.0:1788918585.722280:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e2823ea/0x2811b8b2b0ac95a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f056e expref: 8 pid: 6911 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918585.722324:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:0.0:1788918585.722332:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff815f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+8:2350:x1875816855168128:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918585.722367:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918585.722387:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000003e2823ea/0x2811b8b2b0ac95a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f056e expref: 8 pid: 6911 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.722400:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e2823ea/0x2811b8b2b0ac95a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f056e expref: 8 pid: 6911 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.722424:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e2823ea/0x2811b8b2b0ac95a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f056e expref: 8 pid: 6911 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.722439:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788918585.722444:0:5910:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918585.722452:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac95a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0575 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.722462:0:5910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac95a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0575 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.722494:0:5910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac95a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0575 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918585.722509:0:5910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff885880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5910:1875816865664000:192.168.202.49@tcp:105: 00000100:00100000:0.0:1788918585.725870:0:5910:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b350c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918585.733338:0:5910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff885880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5910:1875816865664000:192.168.202.49@tcp:105: 00010000:00010000:2.0:1788918585.733366:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918585.733438:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff815f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855168128:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 11105us (11314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918585.733450:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:1.0:1788918585.736904:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918585.739455:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855168256 00000100:00100000:2.0:1788918585.739487:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855168256 00002000:00100000:2.0:1788918585.739547:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff94ffeff6aa00 x1875816855168256/t0(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:456/0 lens 504/0 e 0 to 0 dl 1788918596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788918585.739560:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffeff6aa00 with x1875816855168256 ext(0->12) 00002000:00010000:2.0:1788918585.739566:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffeff6aa00 00000100:00100000:2.0:1788918585.739616:0:6915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:2.0:1788918585.739626:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855168256:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788918585.741101:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b921db9-4859-438b-976e-b950f67eace4+9:2350:x1875816855168256:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 Request processed in 1466us (4196us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788918585.741127:0:6915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00002000:00100000:2.0:1788918585.741140:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff94ffeff6aa00 x1875816855168256/t4294967309(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:456/0 lens 504/448 e 0 to 0 dl 1788918596 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788918585.741151:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffeff6aa00 with x1875816855168256 ext(0->12) 00002000:00010000:2.0:1788918585.741157:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffeff6aa00 00000100:00100000:1.0:1788918585.751076:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918585.751431:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855168384 00000100:00100000:2.0:1788918585.751441:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855168384 00000100:00100000:2.0:1788918585.751504:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 127 00000100:00100000:2.0:1788918585.751515:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+20:10469:x1875816855168384:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788918585.758339:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:0.0:1788918585.758363:0:5903:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788918585.758457:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:3.0:1788918585.758471:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1788918585.758665:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+16:10469:x1875816855168384:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 Request processed in 7146us (7640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918585.758674:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 127 00000100:00100000:0.0:1788918585.764447:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918585.764707:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855168512 00000100:00100000:2.0:1788918585.764717:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855168512 00000100:00100000:2.0:1788918585.764788:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:2.0:1788918585.764798:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+9:2349:x1875816855168512:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788918585.771809:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1788918585.771830:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:2.0:1788918585.772075:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855168512:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 Request processed in 7273us (7632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918585.772087:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:1.0:1788918585.780873:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918585.781085:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855168768 00000100:00100000:3.0:1788918585.781105:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855168768 00000100:00100000:3.0:1788918585.781177:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 128 00000100:00100000:3.0:1788918585.781187:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+16:10469:x1875816855168768:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788918585.781260:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918585.781287:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac959b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0567 expref: 16 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.781309:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94ffff5d1900) 00010000:00010000:3.0:1788918585.781315:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918585.781342:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.781356:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.781365:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788918585.781500:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037892d37 reply state 000000007ded0739 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918585.781510:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788918585.782885:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+17:10469:x1875816855168768:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 1690us (2011us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788918585.782897:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 128 00010000:00010000:3.0:1788918585.788413:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.788431:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.788439:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.788445:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918585.788450:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.788457:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.788473:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94ffff5d1900) 00010000:00010000:3.0:1788918585.788476:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918585.788481:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.788487:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918585.789332:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918585.789557:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855168896 00000100:00100000:0.0:1788918585.789568:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855168896 00000100:00100000:0.0:1788918585.789629:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:0.0:1788918585.789640:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855168896:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788918585.790091:0:7258:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788918585.790096:0:7258:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788918583 00002000:00010000:0.0:1788918585.790098:0:7258:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788918582 00002000:00010000:0.0:1788918585.790100:0:7258:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788918584 -> 1788918583 00002000:00010000:0.0:1788918585.790103:0:7258:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788918585.790169:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855168896:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 530us (844us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788918585.790177:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:1.0:1788918585.810395:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918585.810496:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855169152 00000100:00100000:3.0:1788918585.810506:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855169152 00000100:00100000:3.0:1788918585.810587:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 129 00000100:00100000:3.0:1788918585.810597:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+16:10469:x1875816855169152:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788918585.810682:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.810713:0:11359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac957f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0559 expref: 16 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.810724:0:11359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.810763:0:11359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac957f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0559 expref: 16 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.810777:0:11359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac957f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0559 expref: 16 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918585.810794:0:11359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff13100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865664128:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918585.810912:0:11359:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a899c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918585.820545:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918585.820669:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855169280 00000100:00100000:1.0:1788918585.820678:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855169280 00010000:00010000:1.0:1788918585.820730:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac957f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0559 expref: 17 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918585.820779:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:1.0:1788918585.820789:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+17:2349:x1875816855169280:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918585.820804:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918585.820811:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac957f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0559 expref: 17 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.820825:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac957f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0559 expref: 17 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.820849:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94ffff5d1900) 00010000:00010000:1.0:1788918585.820854:0:5909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.820877:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.820885:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.820906:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918585.820964:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+17:2349:x1875816855169280:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 176us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918585.820972:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 59 00010000:00010000:2.0:1788918585.821161:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac957f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0559 expref: 16 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918585.821179:0:11359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff13100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865664128:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918585.821201:0:11359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.821211:0:11359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.821218:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.821257:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.821266:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.821273:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.821279:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918585.821284:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.821292:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.821309:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94ffff5d1900) 00010000:00010000:2.0:1788918585.821312:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788918585.821316:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.821323:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac95b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918585.821361:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+15:10469:x1875816855169152:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 Request processed in 10766us (10978us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788918585.821369:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 129 00000100:00100000:0.0:1788918585.843070:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918585.855465:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855169408 00000100:00100000:1.0:1788918585.855481:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855169408 00000100:00100000:1.0:1788918585.855581:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:1.0:1788918585.855593:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855169408:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788918585.855647:0:6912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.855669:0:6912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac95a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0575 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.855678:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918585.855682:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788918585.855697:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.855741:0:6912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac95a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0575 expref: 7 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.855782:0:6912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac95a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0575 expref: 7 pid: 6909 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918585.855798:0:6912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1875816865664256:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918585.855915:0:6912:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe9846cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918585.871458:0:6912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1875816865664256:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918585.871494:0:6912:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918585.871920:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918585.872049:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855169536 00000100:00100000:1.0:1788918585.872057:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855169536 00010000:00010000:1.0:1788918585.872216:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac95a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0575 expref: 8 pid: 6909 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918585.872434:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:1.0:1788918585.872445:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+8:2350:x1875816855169536:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918585.872460:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918585.872482:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac95a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0575 expref: 8 pid: 6909 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.872495:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac95a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0575 expref: 8 pid: 6909 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.872519:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac95a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0575 expref: 8 pid: 6909 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.872554:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788918585.872559:0:5911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788918585.872685:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.872709:0:5911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.872786:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918585.872850:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855169536:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 407us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918585.872858:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 60 00010000:00010000:0.0:1788918585.873850:0:6912:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.873864:0:6912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.873886:0:6912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.873895:0:6912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.873922:0:6912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.873929:0:6912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918585.873934:0:6912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.873944:0:6912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.873959:0:6912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918585.873967:0:6912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0ac95be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918585.874075:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2350:x1875816855169408:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 Request processed in 18483us (31062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918585.874084:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:0.0:1788918585.885332:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918585.885456:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855169792 00000100:00100000:2.0:1788918585.885466:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855169792 00000100:00100000:2.0:1788918585.885838:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 130 00000100:00100000:2.0:1788918585.885851:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+15:10469:x1875816855169792:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788918585.885939:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.885956:0:5926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac94b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0521 expref: 15 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.885966:0:5926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.886003:0:5926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac94b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0521 expref: 15 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.886017:0:5926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac94b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0521 expref: 15 pid: 5926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918585.886100:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff815c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865664384:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788918585.887375:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2afe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788918585.896144:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff815c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865664384:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918585.896176:0:5926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918585.912789:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918585.913459:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855169920 00000100:00100000:2.0:1788918585.913470:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855169920 00010000:00010000:2.0:1788918585.913513:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac94b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0521 expref: 16 pid: 5926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918585.913796:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:2.0:1788918585.913808:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5095450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+16:2350:x1875816855169920:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918585.913825:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918585.913832:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac94b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0521 expref: 16 pid: 5926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.913847:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac94b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0521 expref: 16 pid: 5926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.913868:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac94b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0521 expref: 16 pid: 5926 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.913885:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:2.0:1788918585.913891:0:5910:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9516 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0544 expref: 15 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.913902:0:5910:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.913930:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.913938:0:5910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.913977:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918585.914064:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5095450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+15:2350:x1875816855169920:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 258us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918585.914072:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 61 00010000:00010000:3.0:1788918585.914470:0:5926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.914480:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.914695:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.914708:0:5926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac958d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0560 expref: 15 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.914716:0:5926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.914745:0:5926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac958d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0560 expref: 15 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.914759:0:5926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac958d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0560 expref: 15 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918585.914773:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff11180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865664512:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918585.914861:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a89cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918585.921222:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918585.921297:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855170048 00000100:00100000:2.0:1788918585.921307:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855170048 00010000:00010000:2.0:1788918585.921348:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac958d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0560 expref: 16 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918585.921384:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00100000:2.0:1788918585.921394:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+16:2349:x1875816855170048:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918585.921409:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918585.921417:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac958d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0560 expref: 16 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.921430:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac958d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0560 expref: 16 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.921451:0:7989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94ffff5d1900) 00010000:00010000:2.0:1788918585.921457:0:7989:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.921486:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.921488:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac958d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0560 expref: 16 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.921494:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918585.921503:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff11180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865664512:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918585.921511:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918585.921521:0:5926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.921541:0:5926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.921547:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918585.921603:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+15:2349:x1875816855170048:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 210us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918585.921610:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 62 00000001:00080000:3.0:1788918585.921673:0:5926:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1788918585.921811:0:5926:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788918585.921845:0:5926:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1788918585.921913:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff11180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5926:1875816865664640:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788918585.921951:0:5926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918585.921977:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a89f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788918585.921997:0:5929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865664640 00000100:00100000:2.0:1788918585.922001:0:5929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865664640 00000100:00100000:2.0:1788918585.922063:0:5929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788918585.922071:0:5929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5926:x1875816865664640:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788918585.922356:0:5929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5926:x1875816865664640:12345-0@lo:1000:mdt00_002.0 Request processed in 285us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918585.922363:0:5929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788918585.922429:0:5926:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788918585.922437:0:5926:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94ffff886d80, transno 4294967307 00000100:00100000:1.0:1788918585.922487:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff11180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5926:1875816865664640:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788918585.922584:0:5926:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788918585.922626:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5926:1875816865664768:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788918585.922655:0:5926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918585.922680:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe9846c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788918585.922799:0:5929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865664768 00000100:00100000:2.0:1788918585.922804:0:5929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865664768 00000100:00100000:2.0:1788918585.922824:0:5929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788918585.922830:0:5929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5926:x1875816865664768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788918585.922972:0:5929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5926:x1875816865664768:12345-0@lo:1000:mdt00_002.0 Request processed in 141us (315us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788918585.922978:0:5929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788918585.923292:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5926:1875816865664768:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788918585.923341:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923350:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923357:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923363:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918585.923368:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923377:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923392:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94ffff5d1900) 00010000:00010000:1.0:1788918585.923395:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788918585.923399:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923405:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac95cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923436:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac950f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923447:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac950f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923453:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac950f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923468:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918585.923471:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac950f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923478:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac950f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923487:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918585.923489:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788918585.923496:0:5926:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9516 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0544 expref: 18 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923506:0:5926:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9516 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0544 expref: 18 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923514:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9516 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0544 expref: 18 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.923540:0:5926:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9516 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0544 expref: 18 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918585.923551:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865664896:192.168.202.49@tcp:105: 00000100:00100000:1.0:1788918585.923629:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe9846c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788918585.927516:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918585.927650:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855170176 00000100:00100000:3.0:1788918585.927673:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855170176 00000100:00100000:3.0:1788918585.927743:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:3.0:1788918585.927754:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+19:10468:x1875816855170176:12345-192.168.202.49@tcp:49:lfs.0 00000100:00100000:3.0:1788918585.927882:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+19:10468:x1875816855170176:12345-192.168.202.49@tcp:49:lfs.0 Request processed in 129us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918585.927889:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:1.0:1788918585.928970:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865664896:192.168.202.49@tcp:105: 00010000:00010000:1.0:1788918585.928999:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac950f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929046:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac950f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929075:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac95d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929089:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac95d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929100:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac95d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929109:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac95d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929305:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac95d3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929312:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac95d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929318:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918585.929323:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac95d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929330:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac95d3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929341:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918585.929344:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918585.929347:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac95d3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929360:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac95d3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929369:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929374:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929380:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929384:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918585.929387:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929394:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929401:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918585.929403:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788918585.929406:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.929411:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac95c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788918585.931682:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788918585.931701:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788918585.932068:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788918585.932075:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788918585.932207:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+18:10469:x1875816855169792:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 46352us (46880us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788918585.932219:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 130 00000020:00080000:1.0:1788918585.932232:0:5926:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788918585.932959:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918585.933119:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855170432 00000100:00100000:0.0:1788918585.933128:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855170432 00000100:00100000:0.0:1788918585.933170:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 131 00000100:00100000:0.0:1788918585.933179:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+18:10468:x1875816855170432:12345-192.168.202.49@tcp:58:lfs.0 00000040:00080000:0.0:1788918585.933321:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788918585.933380:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+18:10468:x1875816855170432:12345-192.168.202.49@tcp:58:lfs.0 Request processed in 202us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918585.933385:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 131 00000100:00100000:3.0:1788918585.943390:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788918585.943413:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865665024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918585.943473:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918585.943513:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865665024 00000100:00100000:2.0:1788918585.943520:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865665024 00000100:00100000:2.0:1788918585.943596:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788918585.943605:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3417:x1875816865665024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918585.943740:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25563712 pending 28672 free 3923664896 avail 3692142592 00000100:00100000:2.0:1788918585.943788:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3417:x1875816865665024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918585.943795:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788918585.948631:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865665024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788918585.951335:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918585.951405:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855170688 00000100:00100000:3.0:1788918585.951414:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855170688 00000100:00100000:3.0:1788918585.951462:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:3.0:1788918585.951472:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc7199450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+18:10469:x1875816855170688:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788918585.951746:0:5927:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788918585.951776:0:5927:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788918585.951810:0:5927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.951843:0:5927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.951855:0:5927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.951864:0:5927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.951870:0:5927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.951874:0:5927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.951890:0:5927:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788918585.951916:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918585.951923:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.951929:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4a00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918585.951933:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.951941:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.951952:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94fff4b4e000) 00010000:00010000:2.0:1788918585.951955:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788918585.951960:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95da lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918585.951965:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5927 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918585.951981:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc7199450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+20:10469:x1875816855170688:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 511us (651us total) trans 4294967408 rc 0/0 00010000:00010000:2.0:1788918585.951983:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918585.951985:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918585.951987:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918585.951989:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 32 00000020:00080000:3.0:1788918585.951994:0:5927:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788918585.966788:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918585.966867:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855170816 00000100:00100000:3.0:1788918585.966876:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855170816 00000100:00100000:3.0:1788918585.966923:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 132 00000100:00100000:3.0:1788918585.966930:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+20:10471:x1875816855170816:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918585.966947:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918585.966964:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac95e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f057c expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.967014:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac95e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.967074:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac95e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.967085:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac95e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.967106:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac95ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.967115:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac95ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.967120:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac95ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.967179:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.967185:0:5925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f053d expref: 21 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.967192:0:5925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95f6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.967218:0:5925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f053d expref: 21 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.967229:0:5925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f053d expref: 21 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918585.967248:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865665152:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918585.967325:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a89c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788918585.978308:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865665152:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918585.978341:0:5925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918585.978576:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918585.978672:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855171072 00000100:00100000:0.0:1788918585.978679:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855171072 00000100:00100000:0.0:1788918585.978751:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:0.0:1788918585.978762:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+22:5432:x1875816855171072:12345-192.168.202.49@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788918585.978945:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+23:5432:x1875816855171072:12345-192.168.202.49@tcp:35:ldlm_bl.0 Request processed in 185us (369us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788918585.978951:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:0.0:1788918585.981592:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918585.981682:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855171200 00000100:00100000:1.0:1788918585.981701:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855171200 00010000:00010000:1.0:1788918585.981738:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f053d expref: 23 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918585.981787:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:1.0:1788918585.981796:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefdded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+23:2349:x1875816855171200:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918585.981808:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918585.981813:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f053d expref: 23 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.981824:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f053d expref: 23 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.981843:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9501 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f053d expref: 23 pid: 5924 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.981857:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918585.981861:0:5911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.981868:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.981873:0:5911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95f6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918585.981918:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918585.981963:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefdded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+22:2349:x1875816855171200:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 167us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918585.981974:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 63 00010000:00010000:3.0:1788918585.982244:0:5925:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982250:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918585.982291:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788918585.982294:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918585.982309:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982319:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982326:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac95e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982330:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac95e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982335:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac95e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982339:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918585.982348:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac95e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982353:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac95e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982359:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:3.0:1788918585.982362:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918585.982365:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac95e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982369:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac95e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982377:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac95ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982380:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac95ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982383:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac95ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982387:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918585.982389:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac95ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982392:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac95ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982395:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94fff4b4e600) 00010000:00010000:3.0:1788918585.982397:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918585.982403:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac95ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982407:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac95ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982432:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac95e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f057c expref: 22 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982440:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f057c expref: 21 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918585.982445:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:3.0:1788918585.982446:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788918585.982448:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4a00, rc 0) 00000100:00100000:3.0:1788918585.982474:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+21:10471:x1875816855170816:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 15545us (15695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918585.982479:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 132 00010000:00010000:2.0:1788918586.006822:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788918586.966797:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788918586.966807:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788918586.966853:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788918586.967301:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788918586.967469:0:12048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7c1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12048:1875816865665280:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788918586.967610:0:12048:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd8821a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788918586.979717:0:12048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7c1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12048:1875816865665280:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788918586.983685:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918586.983872:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855171328 00000100:00100000:2.0:1788918586.983886:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855171328 00000100:00100000:2.0:1788918586.983990:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 133 00000100:00100000:2.0:1788918586.984001:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+21:10482:x1875816855171328:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788918586.984075:0:11359:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:3.0:1788918586.984352:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918586.984661:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+21:10482:x1875816855171328:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 660us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918586.984671:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 133 00000100:00100000:3.0:1788918586.995008:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918586.998917:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855171584 00000100:00100000:1.0:1788918586.998940:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855171584 00000100:00100000:1.0:1788918586.999061:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 134 00000100:00100000:1.0:1788918586.999075:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+21:10482:x1875816855171584:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788918586.999115:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918586.999145:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac95fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0583 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918586.999289:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9604 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918586.999309:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918586.999326:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918586.999341:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788918586.999515:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac95fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0583 expref: 24 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918586.999548:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0583 expref: 23 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918586.999559:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918586.999563:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788918586.999567:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5400, rc 0) 00000100:00100000:1.0:1788918587.000478:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+23:10482:x1875816855171584:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 1400us (5478us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788918587.000489:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 134 00000100:00100000:0.0:1788918587.020569:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918587.020644:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918587.020743:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855171712 00000100:00100000:3.0:1788918587.020755:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855171712 00000100:00100000:3.0:1788918587.020848:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:3.0:1788918587.020860:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+23:2349:x1875816855171712:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918587.020881:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918587.020913:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9604 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0583 expref: 23 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918587.020954:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:3.0:1788918587.020961:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918587.021057:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+22:2349:x1875816855171712:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 199us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918587.021067:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:2.0:1788918587.021416:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855171968 00000100:00100000:2.0:1788918587.021423:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855171968 00000100:00100000:2.0:1788918587.021461:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 135 00000100:00100000:2.0:1788918587.021470:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+22:10482:x1875816855171968:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788918587.021561:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac9612 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918587.021581:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac9612 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918587.021605:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac9612 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918587.021833:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac9612 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918587.021841:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac9612 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918587.021848:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac9612 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918587.021854:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918587.021859:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac9612 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918587.021880:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac9612 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918587.021891:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:2.0:1788918587.021894:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788918587.021899:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac9612 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918587.021907:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0ac9612 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918587.022053:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+23:10482:x1875816855171968:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 584us (1498us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788918587.022061:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 135 00000040:00080000:2.0:1788918587.022381:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788918587.022387:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788918587.022990:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788918587.023000:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788918587.041751:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918587.042200:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855172224 00000100:00100000:3.0:1788918587.042215:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855172224 00000100:00100000:3.0:1788918587.042289:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:3.0:1788918587.042301:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+23:10482:x1875816855172224:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788918587.045076:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+24:10482:x1875816855172224:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 2761us (3327us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788918587.049933:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 34 00010000:00010000:3.0:1788918587.051775:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788918587.173729:0:12460:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788918587.173744:0:12460:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788918587.173783:0:12460:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788918587.173791:0:12460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788918587.509984:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918587.516006:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855172480 00000100:00100000:0.0:1788918587.516045:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855172480 00000100:00100000:0.0:1788918587.516150:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 136 00000100:00100000:0.0:1788918587.516163:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+24:10496:x1875816855172480:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918587.516199:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918587.516251:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac9619 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f058a expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918587.516405:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac9620 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918587.516426:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac9620 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918587.516441:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac9620 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918587.516454:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788918587.519242:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20800/0x2811b8b2b0ac9619 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f058a expref: 27 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918587.519280:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac9620 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f058a expref: 26 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918587.519293:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:0.0:1788918587.519298:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788918587.519303:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21600, rc 0) 00000100:00100000:0.0:1788918587.519394:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+26:10496:x1875816855172480:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 3232us (9423us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788918587.519405:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 136 00000100:00100000:2.0:1788918587.545105:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918587.545847:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855172608 00000100:00100000:3.0:1788918587.545861:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855172608 00000100:00100000:3.0:1788918587.545941:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 137 00000100:00100000:3.0:1788918587.545954:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+26:10496:x1875816855172608:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:3.0:1788918587.546071:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac962e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918587.546096:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac962e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918587.546112:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac962e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918587.546179:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac962e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918587.546188:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac962e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918587.546195:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac962e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918587.546202:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918587.546208:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac962e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918587.546218:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac962e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918587.546234:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:3.0:1788918587.546238:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788918587.546245:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac962e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918587.546252:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac962e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918587.546360:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+26:10496:x1875816855172608:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 409us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918587.546369:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 137 00000100:00100000:0.0:1788918587.750717:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918587.750922:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855172736 00000100:00100000:2.0:1788918587.750936:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855172736 00000100:00100000:2.0:1788918587.751063:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:2.0:1788918587.751075:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2350:x1875816855172736:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:2.0:1788918587.751131:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918587.751157:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0ac9635 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0591 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788918587.751189:0:6909:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa0bb37, atime: 0x6aa0bb36, ctime: 0x6aa0bb37, blocks: 0x8 00010000:00010000:2.0:1788918587.751215:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=290s v=(0 0) 00010000:00010000:2.0:1788918587.751220:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918587.751232:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0ac9635 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0591 expref: 7 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918587.751254:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0ac9635 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0591 expref: 7 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918587.751271:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dc800, rc 0) 00000100:00100000:2.0:1788918587.751350:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855172736:12345-192.168.202.49@tcp:101:cat.0 Request processed in 278us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918587.751358:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00080000:3.0:1788918587.751439:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788918587.754755:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918587.755056:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855172864 00000100:00100000:0.0:1788918587.755071:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855172864 00002000:00100000:0.0:1788918587.755163:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff94ffeff11180 x1875816855172864/t0(0) o3->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:458/0 lens 488/0 e 0 to 0 dl 1788918598 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788918587.755201:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffeff11180 with x1875816855172864 ext(0->4095) 00002000:00010000:0.0:1788918587.755209:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffeff11180 00000100:00100000:0.0:1788918587.755251:0:6917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:0.0:1788918587.755262:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855172864:12345-192.168.202.49@tcp:3:cat.0 00000100:00100000:0.0:1788918587.755504:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855172864:12345-192.168.202.49@tcp:3:cat.0 Request processed in 242us (762us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788918587.755512:0:6917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 3 00002000:00100000:0.0:1788918587.755519:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff94ffeff11180 x1875816855172864/t0(0) o3->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:458/0 lens 488/4536 e 0 to 0 dl 1788918598 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788918587.755528:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffeff11180 with x1875816855172864 ext(0->4095) 00002000:00010000:0.0:1788918587.755531:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffeff11180 00010000:00010000:2.0:1788918588.055010:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788918589.086139:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788918589.086154:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788918589.086180:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788918589.086190:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788918589.089620:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788918589.532271:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788918589.532288:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1788918590.052175:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865665408:0@lo:400:kworker.0 00000100:00100000:2.0:1788918590.052242:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918590.052286:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865665920:0@lo:400:kworker.0 00000100:00100000:2.0:1788918590.052314:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918590.052549:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865665920 00000100:00100000:0.0:1788918590.052557:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865665920 00000100:00100000:0.0:1788918590.052609:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788918590.052619:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865665920:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1788918590.053213:0:8366:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 292334191079ns, next at 293334188604ns, rc = 0 00000100:00100000:0.0:1788918590.053511:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865665920:12345-0@lo:400:kworker.0 Request processed in 892us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918590.053521:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1788918590.053548:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918590.054750:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865665920:0@lo:400:kworker.0 00000100:00100000:2.0:1788918590.054776:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788918590.054784:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865665536:0@lo:400:kworker.0 00000100:00100000:2.0:1788918590.054830:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918590.054863:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865666048:0@lo:400:kworker.0 00000100:00100000:2.0:1788918590.054888:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918590.054928:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865665664:0@lo:400:kworker.0 00000100:00100000:2.0:1788918590.054949:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918590.054966:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865666176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918590.054985:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918590.055004:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788918590.055010:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865665792:0@lo:400:kworker.0 00000100:00100000:2.0:1788918590.055051:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918590.055083:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865665408 00000100:00100000:2.0:1788918590.055089:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865665408 00000100:00100000:2.0:1788918590.055126:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788918590.055132:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865665408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918590.055173:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865665408:12345-0@lo:400:kworker.0 Request processed in 40us (2930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918590.055180:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788918590.055205:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865665536 00000100:00100000:2.0:1788918590.055209:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865665536 00000100:00100000:2.0:1788918590.055231:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865665664 00000100:00100000:2.0:1788918590.055234:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865665664 00000100:00100000:2.0:1788918590.055259:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788918590.055265:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865665536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918590.055304:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865665536:12345-0@lo:400:kworker.0 Request processed in 40us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918590.055311:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788918590.055322:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788918590.055327:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865665664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918590.056548:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865666048 00000100:00100000:0.0:1788918590.056560:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865666048 00000100:00100000:0.0:1788918590.056608:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865665792 00000100:00100000:0.0:1788918590.056611:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865665792 00000100:00100000:0.0:1788918590.056635:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788918590.056645:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3419:x1875816865666048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918590.056732:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3419:x1875816865666048:12345-0@lo:400:kworker.0 Request processed in 89us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918590.056740:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788918590.056758:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788918590.056765:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865665792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918590.056804:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865665792:12345-0@lo:400:kworker.0 Request processed in 40us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918590.056810:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788918590.056830:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788918590.056834:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788918590.056836:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918590.056876:0:3417:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788918590.056882:0:3417:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788918590.056900:0:3417:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94ffeff69f80, transno 4294967304 00000100:00100000:0.0:1788918590.056911:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865665792:0@lo:400:kworker.0 00000100:00100000:2.0:1788918590.057258:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865665664:12345-0@lo:400:kworker.0 Request processed in 1928us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918590.057266:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788918590.057287:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865666176 00000100:00100000:2.0:1788918590.057291:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865666176 00000100:00100000:2.0:1788918590.057320:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788918590.057327:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1875816865666176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788918590.059496:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25506368 pending 0 free 3923664896 avail 3692142592 00000100:00100000:2.0:1788918590.059566:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1875816865666176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2238us (4578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918590.059574:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788918590.059666:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865665536:0@lo:400:kworker.0 00000100:00100000:2.0:1788918590.059682:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865666048:0@lo:400:kworker.0 00000100:00100000:2.0:1788918590.059699:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865665408:0@lo:400:kworker.0 00000100:00100000:0.0:1788918590.060711:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865665664:0@lo:400:kworker.0 00000100:00100000:0.0:1788918590.060730:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865666176:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788918590.102835:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918590.651417:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918590.651474:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918590.652013:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855173120 00000100:00100000:3.0:1788918590.652084:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855173120 00000100:00100000:3.0:1788918590.652182:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 143 00000100:00100000:3.0:1788918590.652193:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+26:2351:x1875816855173120:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918590.652287:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+26:2351:x1875816855173120:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 96us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918590.652295:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 143 00000100:00080000:1.0:1788918590.652678:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918590.653617:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855172992 00000100:00100000:0.0:1788918590.653626:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855172992 00000100:00100000:0.0:1788918590.653716:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 288 00000100:00100000:0.0:1788918590.653725:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855172992:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918590.653792:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855172992:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 68us (2391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918590.653800:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 288 00000100:00100000:1.0:1788918590.677194:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918590.677246:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918590.677292:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918590.677476:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855173248 00000100:00100000:2.0:1788918590.677494:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855173248 00000100:00100000:2.0:1788918590.677576:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855173376 00000100:00100000:2.0:1788918590.677581:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855173376 00000100:00100000:2.0:1788918590.677611:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 72 00000100:00100000:2.0:1788918590.677640:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2350:x1875816855173248:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918590.677757:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2350:x1875816855173248:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 120us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918590.677765:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 72 00000100:00100000:2.0:1788918590.677783:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 73 00000100:00100000:2.0:1788918590.677790:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855173376:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918590.677817:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855173376:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 27us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918590.677837:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 73 00000100:00100000:3.0:1788918590.679932:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855173504 00000100:00100000:3.0:1788918590.679954:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855173504 00000100:00100000:3.0:1788918590.680109:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 144 00000100:00100000:3.0:1788918590.680121:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2350:x1875816855173504:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918590.680231:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2350:x1875816855173504:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 113us (2938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918590.680239:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 144 00000100:00080000:1.0:1788918590.681241:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788918590.681253:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788918590.681257:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788918591.062949:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865666304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788918591.063050:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918591.063930:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865666304 00000100:00100000:3.0:1788918591.063942:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865666304 00000100:00100000:3.0:1788918591.064005:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788918591.064015:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865666304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788918591.064068:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25535040 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918591.064140:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865666304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918591.064147:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788918591.064392:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865666304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788918591.126974:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788918591.581924:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788918591.581945:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000004:00080000:0.0:1788918591.583942:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:0.0:1788918591.583969:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788918591.583993:0:5903:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94ffe9846480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788918591.583998:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94ffc3547300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94ffe9846cc0 00000020:00080000:0.0:1788918591.584001:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94ffc3547b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94ffff7f3e00 00000020:00080000:3.0:1788918591.584265:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788918591.584329:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1788918591.584654:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865666432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788918591.584722:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918591.584919:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865666432 00000100:00100000:1.0:1788918591.584938:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865666432 00000100:00100000:1.0:1788918591.584986:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788918591.584995:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865666432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788918591.585134:0:6909:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788918591.585138:0:6909:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788918583 -> 1788918583 00002000:00010000:1.0:1788918591.585141:0:6909:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1788918582 -> 1788918582 00002000:00010000:1.0:1788918591.585143:0:6909:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788918583 -> 1788918583 00002000:00010000:1.0:1788918591.585146:0:6909:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788918591.585183:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3419:x1875816865666432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 189us (460us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788918591.585190:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788918591.585291:0:3419:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788918591.585302:0:3419:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:3.0:1788918591.585325:0:3419:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94fff692ca80 x1875816865666432/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788918607 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788918591.585336:0:3419:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94fff692ca80/2, rc 0, transno 4294967312 00000100:00100000:3.0:1788918591.585341:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865666432:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788918592.150245:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918593.174603:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918594.198288:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918595.159762:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865666560:0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.159829:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918595.159907:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865667072:0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.159930:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918595.159953:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788918595.159958:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865666944:0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.159978:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918595.160003:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865666688:0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.160063:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918595.160083:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865667200:0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.160103:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918595.160120:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788918595.160126:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865666816:0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.160146:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918595.160178:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865667072 00000100:00100000:2.0:1788918595.160186:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865667072 00000100:00100000:2.0:1788918595.160237:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865666688 00000100:00100000:2.0:1788918595.160240:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865666688 00000100:00100000:2.0:1788918595.161769:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865666816 00000100:00100000:2.0:1788918595.161779:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865666816 00000100:00100000:2.0:1788918595.161807:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788918595.161816:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865667072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.161891:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865667072:12345-0@lo:400:kworker.0 Request processed in 76us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918595.161899:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788918595.161917:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788918595.161923:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865666688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.161957:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865666688:12345-0@lo:400:kworker.0 Request processed in 34us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918595.161962:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788918595.161973:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788918595.161980:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865666816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.162007:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865666816:12345-0@lo:400:kworker.0 Request processed in 27us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918595.162038:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788918595.162063:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865666944 00000100:00100000:2.0:1788918595.162067:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865666944 00000100:00100000:2.0:1788918595.162097:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865667200 00000100:00100000:2.0:1788918595.162100:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865667200 00000100:00100000:2.0:1788918595.162119:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788918595.162126:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865666944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.162158:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865666944:12345-0@lo:400:kworker.0 Request processed in 33us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918595.162164:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788918595.162175:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788918595.162180:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3417:x1875816865667200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.162207:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3417:x1875816865667200:12345-0@lo:400:kworker.0 Request processed in 27us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918595.162212:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788918595.162237:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788918595.162240:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788918595.162243:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918595.162582:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865666816:0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.162595:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865666688:0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.162620:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865667200:0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.162655:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865666944:0@lo:400:kworker.0 00000100:00100000:2.0:1788918595.162666:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865667072:0@lo:400:kworker.0 00000100:00100000:1.0:1788918595.163214:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788918595.163225:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865667328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918595.163392:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918595.163427:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865667328 00000100:00100000:1.0:1788918595.163432:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865667328 00000100:00100000:1.0:1788918595.163527:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788918595.163535:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1875816865667328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918595.163559:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25506368 pending 0 free 3923664896 avail 3692142592 00000100:00100000:1.0:1788918595.163594:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3417:x1875816865667328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918595.163612:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788918595.163650:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865667328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918595.164373:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865666560 00000100:00100000:0.0:1788918595.164379:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865666560 00000100:00100000:0.0:1788918595.164420:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788918595.164428:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865666560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918595.164685:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865666560:12345-0@lo:400:kworker.0 Request processed in 258us (4855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918595.164693:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788918595.164857:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865666560:0@lo:400:kworker.0 00010000:00010000:3.0:1788918595.227063:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918595.778858:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918595.779059:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855173632 00000100:00100000:3.0:1788918595.779069:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855173632 00000100:00100000:3.0:1788918595.779123:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 290 00000100:00100000:3.0:1788918595.779133:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855173632:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918595.779206:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855173632:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 75us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918595.779214:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 290 00000100:00100000:3.0:1788918595.781736:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918595.781779:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918595.781813:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918595.781904:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855173888 00000100:00100000:2.0:1788918595.781925:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855173888 00000100:00100000:2.0:1788918595.781980:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 76 00000100:00100000:2.0:1788918595.781989:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2351:x1875816855173888:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918595.782079:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2351:x1875816855173888:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 90us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918595.782087:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 76 00000100:00080000:2.0:1788918595.782108:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918595.782283:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918595.784043:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855174016 00000100:00100000:2.0:1788918595.784054:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855174016 00000100:00100000:2.0:1788918595.784121:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00100000:2.0:1788918595.784131:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855174016:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918595.784191:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2351:x1875816855174016:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 62us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918595.784198:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00080000:3.0:1788918595.786387:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788918595.793863:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855174144 00000100:00100000:1.0:1788918595.793879:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855174144 00000100:00080000:3.0:1788918595.794047:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918595.794565:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855173760 00000100:00100000:1.0:1788918595.794584:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855173760 00000100:00100000:1.0:1788918595.794645:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 148 00000100:00100000:1.0:1788918595.794657:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855174144:12345-192.168.202.49@tcp:400:kworker.0 00000100:00080000:3.0:1788918595.794754:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918595.794789:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 149 00000100:00100000:3.0:1788918595.794799:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+13:2351:x1875816855173760:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918595.794870:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+13:2351:x1875816855173760:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 74us (13056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918595.794878:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 149 00000100:00100000:1.0:1788918595.795548:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855174144:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 892us (13766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918595.795565:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 148 00000100:00100000:2.0:1788918595.836096:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918595.836315:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855174272 00000100:00100000:3.0:1788918595.836326:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855174272 00000100:00100000:3.0:1788918595.836389:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 138 00000100:00100000:3.0:1788918595.836400:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+13:10148:x1875816855174272:12345-192.168.202.49@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788918595.836523:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+13:10148:x1875816855174272:12345-192.168.202.49@tcp:60:lhsmtool_posix.0 Request processed in 124us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918595.836531:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 138 00000100:00100000:3.0:1788918595.839539:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918595.839682:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855174528 00000100:00100000:0.0:1788918595.839691:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855174528 00000100:00100000:0.0:1788918595.839746:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:0.0:1788918595.839757:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+13:10148:x1875816855174528:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788918595.839972:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+14:10148:x1875816855174528:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 216us (439us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788918595.839979:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:1.0:1788918596.143645:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918596.143809:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855174656 00000100:00100000:0.0:1788918596.143820:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855174656 00000100:00100000:0.0:1788918596.143881:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 139 00000100:00100000:0.0:1788918596.143890:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:10948:x1875816855174656:12345-192.168.202.49@tcp:101:lsof.0 00010000:00010000:0.0:1788918596.143911:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918596.143968:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac963c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0598 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918596.144106:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9643 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918596.144122:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918596.144136:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918596.144182:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788918596.144186:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788918596.144224:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918596.144430:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac963c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0598 expref: 7 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918596.144461:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9643 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0598 expref: 6 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918596.144470:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:0.0:1788918596.144473:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788918596.144476:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20c00, rc 0) 00000100:00100000:0.0:1788918596.144538:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:10948:x1875816855174656:12345-192.168.202.49@tcp:101:lsof.0 Request processed in 649us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918596.144545:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 139 00000100:00100000:0.0:1788918596.182459:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788918596.182483:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865667456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788918596.182579:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918596.183101:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865667456 00000100:00100000:1.0:1788918596.183109:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865667456 00000100:00100000:1.0:1788918596.183165:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788918596.183175:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865667456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788918596.183203:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25535040 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918596.183392:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865667456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 217us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918596.183399:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788918596.191228:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865667456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788918596.246356:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918597.273572:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788918597.725451:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1788918597.736911:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788918597.736946:0:5903:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788918597.737133:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788918597.737148:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788918598.299131:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918599.321042:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788918599.323207:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788918599.323217:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788918599.323821:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788918599.323831:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788918600.278323:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865667584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918600.278422:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918600.278639:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865667584 00000100:00100000:1.0:1788918600.278648:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865667584 00000100:00100000:1.0:1788918600.278736:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788918600.278748:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865667584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918600.278785:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25506368 pending 0 free 3923664896 avail 3692142592 00000100:00100000:1.0:1788918600.278840:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865667584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918600.278848:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788918600.278984:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788918600.279087:0:3420:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788918600.279093:0:3420:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94fff692ca80, transno 4294967312 00000100:00100000:0.0:1788918600.279111:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865667584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918600.279381:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865667712:0@lo:400:kworker.0 00000100:00100000:0.0:1788918600.279424:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918600.279457:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865668224:0@lo:400:kworker.0 00000100:00100000:0.0:1788918600.279483:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918600.279515:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788918600.279521:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865667840:0@lo:400:kworker.0 00000100:00100000:0.0:1788918600.279541:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918600.279581:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865668224 00000100:00100000:0.0:1788918600.279586:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865668224 00000100:00100000:0.0:1788918600.279624:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865667840 00000100:00100000:0.0:1788918600.279627:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865667840 00000100:00100000:0.0:1788918600.279644:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788918600.279651:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865668224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918600.279703:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865668224:12345-0@lo:400:kworker.0 Request processed in 52us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918600.279710:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788918600.279752:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788918600.279758:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865667840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918600.279786:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865667840:12345-0@lo:400:kworker.0 Request processed in 29us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918600.279793:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788918600.279823:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865667840:0@lo:400:kworker.0 00000100:00100000:0.0:1788918600.279833:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865668224:0@lo:400:kworker.0 00000100:00100000:0.0:1788918600.279851:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865668096:0@lo:400:kworker.0 00000100:00100000:0.0:1788918600.279879:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918600.279896:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788918600.279901:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865667968:0@lo:400:kworker.0 00000100:00100000:0.0:1788918600.279921:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918600.279942:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865667968 00000100:00100000:0.0:1788918600.279945:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865667968 00000100:00100000:0.0:1788918600.279968:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788918600.279974:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865667968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918600.280004:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865667968:12345-0@lo:400:kworker.0 Request processed in 30us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918600.280010:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788918600.280060:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865667968:0@lo:400:kworker.0 00000100:00100000:2.0:1788918600.280248:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865668096 00000100:00100000:2.0:1788918600.280253:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865668096 00000100:00100000:2.0:1788918600.280291:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788918600.280299:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865668096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918600.280337:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865668096:12345-0@lo:400:kworker.0 Request processed in 40us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918600.280350:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788918600.280417:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865667712 00000100:00100000:3.0:1788918600.280421:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865667712 00000100:00100000:3.0:1788918600.280458:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788918600.280465:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865667712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918600.280513:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865667712:12345-0@lo:400:kworker.0 Request processed in 48us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918600.280519:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:3.0:1788918600.280548:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788918600.280563:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918600.280579:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865667712:0@lo:400:kworker.0 00000100:00100000:0.0:1788918600.280818:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865668096:0@lo:400:kworker.0 00010000:00010000:2.0:1788918600.345090:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918600.881648:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918600.881703:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918600.881744:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918600.881787:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918600.881864:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918600.881909:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855175296 00000100:00100000:3.0:1788918600.881923:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855175296 00000100:00100000:3.0:1788918600.882003:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855174912 00000100:00100000:3.0:1788918600.882007:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855174912 00000100:00100000:3.0:1788918600.882091:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 153 00000100:00100000:3.0:1788918600.882104:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2352:x1875816855175296:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918600.882212:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2352:x1875816855175296:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 111us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918600.882221:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 153 00000100:00100000:3.0:1788918600.882242:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 154 00000100:00100000:3.0:1788918600.882250:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+13:2352:x1875816855174912:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918600.882282:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+13:2352:x1875816855174912:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 33us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918600.882289:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 154 00000100:00080000:3.0:1788918600.882308:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918600.882613:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855175040 00000100:00100000:2.0:1788918600.882620:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855175040 00000100:00100000:2.0:1788918600.882668:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855175168 00000100:00100000:2.0:1788918600.882671:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855175168 00000100:00100000:2.0:1788918600.882700:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:2.0:1788918600.882709:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855175040:12345-192.168.202.49@tcp:400:kworker.0 00000100:00080000:3.0:1788918600.882743:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788918600.882747:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788918600.882753:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855175040:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 45us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918600.882761:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:2.0:1788918600.882779:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:2.0:1788918600.882788:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855175168:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918600.882816:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855175168:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 30us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918600.882823:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:1.0:1788918600.883574:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855174784 00000100:00100000:1.0:1788918600.883583:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855174784 00000100:00100000:1.0:1788918600.883621:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 292 00000100:00100000:1.0:1788918600.883629:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855174784:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918600.883694:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855174784:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 64us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918600.883702:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 292 00000100:00100000:2.0:1788918601.327065:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865668352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788918601.327162:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918601.327262:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865668352 00000100:00100000:2.0:1788918601.327273:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865668352 00000100:00100000:2.0:1788918601.327873:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788918601.327951:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865668352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918601.327996:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25535040 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918601.328094:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865668352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 210us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918601.328113:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788918601.328668:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865668352:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788918601.366269:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788918602.257953:0:12658:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:49:58 (1788918598) 00010000:00010000:1.0:1788918602.391193:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918603.416833:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918604.438424:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918604.605176:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918604.605412:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855175552 00000100:00100000:0.0:1788918604.605423:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855175552 00000100:00100000:0.0:1788918604.605530:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 140 00000100:00100000:0.0:1788918604.605543:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+13:11214:x1875816855175552:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788918604.605589:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918604.605614:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac964a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f059f expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788918604.605645:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788918604.605693:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9651 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.605707:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9651 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.605718:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9651 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.605813:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9658 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.605821:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9658 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.605829:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9658 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.605924:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac965f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.605933:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac965f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.605940:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac965f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918604.605950:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788918604.606091:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9651 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.606099:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9651 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.606114:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9651 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.606121:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918604.606126:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9651 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.606134:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9651 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.606146:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94fff681c800) 00010000:00010000:0.0:1788918604.606149:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918604.606155:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9651 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.606161:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9651 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.606174:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9658 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.606180:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9658 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.606185:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9658 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.606201:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918604.606204:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9658 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.606209:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9658 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.606217:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94fff6819f00) 00010000:00010000:0.0:1788918604.606220:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918604.606222:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9658 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.606228:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9658 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.607084:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac964a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f059f expref: 16 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.607105:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac965f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f059f expref: 15 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918604.607113:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94fffbdf3600) 00010000:00010000:0.0:1788918604.607115:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918604.607118:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21800, rc 0) 00000100:00100000:0.0:1788918604.607194:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+15:11214:x1875816855175552:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 1654us (2027us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788918604.607202:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 140 00000001:00080000:2.0:1788918604.611438:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:0.0:1788918604.617575:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918604.617639:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918604.617868:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855175808 00000100:00100000:1.0:1788918604.617878:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855175808 00000100:00100000:1.0:1788918604.617942:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:1.0:1788918604.617952:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+14:2351:x1875816855175808:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918604.617967:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918604.617990:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac965f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f059f expref: 14 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918604.618009:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94fffbdf3600) 00010000:00010000:1.0:1788918604.618014:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918604.618133:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+13:2351:x1875816855175808:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 182us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918604.618141:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:3.0:1788918604.618274:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855175680 00000100:00100000:3.0:1788918604.618278:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855175680 00000100:00100000:3.0:1788918604.618317:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 141 00000100:00100000:3.0:1788918604.618325:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+13:11214:x1875816855175680:12345-192.168.202.49@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788918604.618397:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+13:11214:x1875816855175680:12345-192.168.202.49@tcp:59:lhsmtool_posix.0 Request processed in 72us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918604.618403:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 141 00000100:00100000:0.0:1788918605.399590:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865668480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918605.399689:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918605.399895:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865668480 00000100:00100000:0.0:1788918605.399906:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865668480 00000100:00100000:0.0:1788918605.399980:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788918605.399991:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffed528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865668480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788918605.400048:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25506368 pending 0 free 3923664896 avail 3692142592 00000100:00100000:0.0:1788918605.400096:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffed528450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865668480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918605.400104:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788918605.402115:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865668736:0@lo:400:kworker.0 00000100:00100000:3.0:1788918605.404131:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788918605.404886:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788918605.404910:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865668736 00000100:00100000:0.0:1788918605.408257:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865668736 00000100:00100000:0.0:1788918605.408339:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788918605.408361:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865668736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918605.408455:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865668736:12345-0@lo:400:kworker.0 Request processed in 107us (4334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918605.408462:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788918605.408498:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865668608:0@lo:400:kworker.0 00000100:00100000:0.0:1788918605.408551:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918605.408590:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865669120:0@lo:400:kworker.0 00000100:00100000:0.0:1788918605.408615:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918605.408638:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788918605.408655:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865668992:0@lo:400:kworker.0 00000100:00100000:0.0:1788918605.408679:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918605.408719:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865668608 00000100:00100000:0.0:1788918605.408723:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865668608 00000100:00100000:0.0:1788918605.408746:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788918605.408752:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865668608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918605.408786:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865668608:12345-0@lo:400:kworker.0 Request processed in 34us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918605.408792:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788918605.408820:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865669120 00000100:00100000:0.0:1788918605.408823:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865669120 00000100:00100000:0.0:1788918605.408855:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788918605.408860:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865669120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918605.408890:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865669120:12345-0@lo:400:kworker.0 Request processed in 30us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918605.408895:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788918605.408913:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865668992 00000100:00100000:0.0:1788918605.408916:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865668992 00000100:00100000:0.0:1788918605.408940:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788918605.408946:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865668992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918605.408973:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865668992:12345-0@lo:400:kworker.0 Request processed in 28us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918605.408979:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788918605.408993:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788918605.408996:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918605.409744:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865668736:0@lo:400:kworker.0 00000100:00100000:3.0:1788918605.409767:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788918605.409775:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865668864:0@lo:400:kworker.0 00000100:00100000:3.0:1788918605.409813:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918605.410445:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865668992:0@lo:400:kworker.0 00000100:00100000:0.0:1788918605.410465:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865668608:0@lo:400:kworker.0 00000100:00100000:0.0:1788918605.410479:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865669120:0@lo:400:kworker.0 00000100:00100000:0.0:1788918605.410562:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865668480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918605.413745:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865668864 00000100:00100000:1.0:1788918605.413761:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865668864 00000100:00100000:1.0:1788918605.413835:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788918605.413847:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865668864:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788918605.413848:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918605.413953:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865668864:12345-0@lo:400:kworker.0 Request processed in 109us (4138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918605.413961:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788918605.414520:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865668864:0@lo:400:kworker.0 00000040:00080000:1.0:1788918605.467240:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788918605.467272:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788918605.468190:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00010000:00010000:2.0:1788918605.468195:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788918605.468207:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788918606.003251:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918606.003290:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918606.003318:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855176064 00000100:00100000:1.0:1788918606.003327:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855176064 00000100:00100000:1.0:1788918606.003400:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 158 00000100:00100000:1.0:1788918606.003410:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+13:2352:x1875816855176064:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918606.003485:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+13:2352:x1875816855176064:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 76us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918606.003494:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 158 00000100:00100000:3.0:1788918606.005297:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855175936 00000100:00100000:3.0:1788918606.005309:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855175936 00000100:00080000:1.0:1788918606.005438:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918606.005514:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 294 00000100:00100000:3.0:1788918606.005525:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffbe89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855175936:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918606.005674:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffbe89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855175936:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 151us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918606.005682:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 294 00000100:00100000:1.0:1788918606.016908:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918606.018627:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855176192 00000100:00100000:3.0:1788918606.018640:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855176192 00000100:00100000:3.0:1788918606.018712:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:3.0:1788918606.018722:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+5:2348:x1875816855176192:12345-192.168.202.49@tcp:9:kworker.0 00000020:00000080:3.0:1788918606.018750:0:6912:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac9007 00000100:00080000:3.0:1788918606.018758:0:6912:0:(import.c:65:import_set_state_nolock()) ffff94ffc2c68000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788918606.018809:0:6912:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967304 00000100:00100000:3.0:1788918606.018984:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+2:2348:x1875816855176192:12345-192.168.202.49@tcp:9:kworker.0 Request processed in 263us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918606.019001:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 47 00010000:00010000:3.0:1788918606.019054:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788918606.019771:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918606.019953:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918606.020056:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918606.020295:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855176448 00000100:00100000:2.0:1788918606.020302:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855176448 00000100:00080000:3.0:1788918606.021798:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918606.026076:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855176320 00000100:00100000:0.0:1788918606.026089:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855176320 00000100:00100000:0.0:1788918606.026165:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 82 00000100:00100000:0.0:1788918606.026174:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2350:x1875816855176320:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918606.026255:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2350:x1875816855176320:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 82us (6312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918606.026262:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 82 00000100:00080000:3.0:1788918606.026451:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788918606.027554:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 159 00000100:00100000:1.0:1788918606.027572:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2350:x1875816855176448:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918606.027646:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2350:x1875816855176448:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 80us (7590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918606.027653:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 159 00000100:00100000:1.0:1788918606.429632:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788918606.429656:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865669248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918606.429726:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918606.430431:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865669248 00000100:00100000:0.0:1788918606.430440:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865669248 00000100:00100000:0.0:1788918606.430512:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788918606.430522:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865669248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788918606.430552:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918606.430606:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865669248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918606.430613:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788918606.430692:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865669248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788918606.490051:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918607.072858:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918607.078885:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855176576 00000100:00100000:2.0:1788918607.078902:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855176576 00000100:00100000:2.0:1788918607.078973:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 142 00000100:00100000:2.0:1788918607.078985:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+13:11256:x1875816855176576:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788918607.079008:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918607.079045:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac966d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f05a6 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079112:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9674 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079126:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9674 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079139:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9674 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079152:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac967b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079159:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac967b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079182:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac967b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079226:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9674 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079234:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9674 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079240:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9674 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079246:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918607.079250:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9674 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079258:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9674 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079268:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:2.0:1788918607.079271:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918607.079276:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9674 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079282:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9674 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079298:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac967b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079305:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac967b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079317:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac967b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079323:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dca00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918607.079326:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac967b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079345:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac967b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079354:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94ffff5d1000) 00010000:00010000:2.0:1788918607.079357:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918607.079360:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac967b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079367:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac967b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079396:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac966d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05a6 expref: 14 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079406:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:2.0:1788918607.079409:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918607.079413:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac966d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05a6 expref: 14 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.079422:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dce00, rc 0) 00000100:00100000:2.0:1788918607.079487:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+13:11256:x1875816855176576:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 506us (6640us total) trans 0 rc 301/301 00000100:00100000:2.0:1788918607.079513:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 142 00000100:00100000:0.0:1788918607.086002:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918607.086130:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855176832 00000100:00100000:1.0:1788918607.086140:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855176832 00000100:00100000:1.0:1788918607.086188:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 143 00000100:00100000:1.0:1788918607.086199:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+13:11256:x1875816855176832:12345-192.168.202.49@tcp:36:lfs.0 00010000:00010000:1.0:1788918607.086268:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918607.086295:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac8fc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03ca expref: 13 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.086312:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:1.0:1788918607.086317:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788918607.086380:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.086395:0:5924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9643 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0598 expref: 5 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.086405:0:5924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.086440:0:5924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9643 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0598 expref: 5 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.086456:0:5924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9643 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0598 expref: 5 pid: 5924 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918607.086473:0:5924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865669376:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918607.086578:0:5924:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc531d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918607.091608:0:5924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865669376:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918607.091645:0:5924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918607.093471:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.096893:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855176960 00000100:00100000:3.0:1788918607.096906:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855176960 00010000:00010000:3.0:1788918607.096949:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9643 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0598 expref: 6 pid: 5924 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918607.096988:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00100000:3.0:1788918607.096996:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2350:x1875816855176960:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918607.097010:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918607.097016:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9643 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0598 expref: 6 pid: 5924 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.097043:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9643 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0598 expref: 6 pid: 5924 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.097064:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9643 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0598 expref: 6 pid: 5924 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.097079:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918607.097084:0:5910:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.097101:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.097109:0:5910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.097133:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918607.097182:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2350:x1875816855176960:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 186us (3718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918607.097189:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 64 00010000:00010000:3.0:1788918607.097214:0:5924:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.097221:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.097241:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9689 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.097252:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9689 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.097259:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9689 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918607.098207:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788918607.098221:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.098230:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.098247:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.098253:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918607.098257:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.098265:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.098275:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918607.098277:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918607.098281:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.098287:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9682 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788918607.098302:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049e78ed0 reply state 00000000ae730ab5 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9689 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918607.098310:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788918607.098378:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+14:11256:x1875816855176832:12345-192.168.202.49@tcp:36:lfs.0 Request processed in 12180us (12386us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788918607.098386:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 143 00010000:00010000:3.0:1788918607.104135:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9689 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.104157:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9689 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.104174:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9689 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.104179:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918607.104184:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9689 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.104192:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9689 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.104210:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94fff4b4e900) 00010000:00010000:3.0:1788918607.104213:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918607.104219:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9689 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.104226:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9689 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918607.192091:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918607.192169:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855177088 00000100:00100000:2.0:1788918607.192179:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855177088 00000100:00100000:2.0:1788918607.192232:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 144 00000100:00100000:2.0:1788918607.192240:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+13:11264:x1875816855177088:12345-192.168.202.49@tcp:101:lctl.0 00010000:00010000:2.0:1788918607.192262:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918607.192282:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9690 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f05ad expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.192333:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9697 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.192343:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.192352:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918607.192391:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788918607.192394:0:11359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918607.192410:0:11359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.192427:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05ad expref: 15 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.192440:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05ad expref: 14 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.192461:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ffff5d1000) 00010000:00010000:2.0:1788918607.192463:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788918607.192466:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dc400, rc 0) 00000100:00100000:2.0:1788918607.192529:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+14:11264:x1875816855177088:12345-192.168.202.49@tcp:101:lctl.0 Request processed in 285us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918607.192536:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 144 00000100:00100000:0.0:1788918607.245599:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.245748:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855177216 00000100:00100000:3.0:1788918607.245759:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855177216 00000100:00100000:3.0:1788918607.245867:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 145 00000100:00100000:3.0:1788918607.245876:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+14:11270:x1875816855177216:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788918607.245896:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918607.245919:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac969e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f05b4 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.245987:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac96a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246015:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac96a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246042:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac96a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246054:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac96ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246058:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac96ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246062:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac96ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246125:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac96b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246130:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac96b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246133:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac96b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918607.246162:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788918607.246164:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918607.246179:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac96b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246188:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac96a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246199:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac96a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246203:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac96a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246207:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918607.246210:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac96a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246215:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac96a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246224:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ffff5d1000) 00010000:00010000:3.0:1788918607.246225:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918607.246229:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac96a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246233:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac96a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246242:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac96ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246245:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac96ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246249:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac96ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246252:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918607.246257:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac96ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246262:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac96ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246266:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94fff4b4e900) 00010000:00010000:3.0:1788918607.246267:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918607.246269:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac96ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246272:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac96ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246293:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac969e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05b4 expref: 16 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246302:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac96b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05b4 expref: 15 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.246306:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918607.246307:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788918607.246308:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5800, rc 0) 00000100:00100000:3.0:1788918607.247685:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+15:11270:x1875816855177216:12345-192.168.202.49@tcp:101:bash.0 Request processed in 1798us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918607.247696:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 145 00000100:00100000:3.0:1788918607.250218:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918607.250716:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855177472 00000100:00100000:2.0:1788918607.250728:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855177472 00000100:00100000:2.0:1788918607.250838:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 146 00000100:00100000:2.0:1788918607.250849:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+15:11270:x1875816855177472:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788918607.250868:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918607.250889:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac96ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f05bb expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.251012:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac96c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.251071:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac96c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.251084:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac96c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.251140:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac96c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.251148:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac96c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.251174:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac96c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788918607.251949:0:11359:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788918607.252115:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac96cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.252127:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac96cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.252135:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac96cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.252165:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac96c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.252172:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac96c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.252179:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac96c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.252185:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dca00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918607.252189:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac96c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.252197:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac96c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.252207:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:2.0:1788918607.252210:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918607.252222:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac96c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.252229:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac96c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788918607.252243:0:11359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000088b1286 reply state 000000001c80ed6d transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac96c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918607.252252:0:11359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788918607.252280:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac96ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05bb expref: 18 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.252293:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac96cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05bb expref: 17 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.252300:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:2.0:1788918607.252303:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918607.252305:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd800, rc 0) 00000100:00100000:2.0:1788918607.252384:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+18:11270:x1875816855177472:12345-192.168.202.49@tcp:101:bash.0 Request processed in 1537us (2173us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788918607.252392:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 146 00010000:00010000:3.0:1788918607.255371:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac96c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.255404:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac96c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.255411:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac96c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.255416:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dce00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918607.255420:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac96c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.255428:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac96c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.255444:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94ffff5d1300) 00010000:00010000:3.0:1788918607.255448:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918607.255453:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac96c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.255459:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac96c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918607.255979:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918607.256047:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855177600 00000100:00100000:0.0:1788918607.256061:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855177600 00000100:00100000:0.0:1788918607.256103:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:0.0:1788918607.256111:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875816855177600:12345-192.168.202.49@tcp:8:bash.0 00010000:00080000:0.0:1788918607.256156:0:6912:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:0.0:1788918607.256191:0:6912:0:(genops.c:1385:class_connect()) connect: client 9b921db9-4859-438b-976e-b950f67eace4, cookie 0x2811b8b2b0ac96dd 00002000:00100000:0.0:1788918607.256203:0:6912:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9b921db9-4859-438b-976e-b950f67eace4/ffff94ffd0673800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 25255936 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788918607.256215:0:6912:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788918607.256304:0:6912:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788918607.256332:0:6912:0:(import.c:65:import_set_state_nolock()) ffff94ffd0671000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788918607.256517:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+6:2348:x1875816855177600:12345-192.168.202.49@tcp:8:bash.0 Request processed in 405us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918607.256525:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:0.0:1788918607.258293:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.258397:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855177728 00000100:00100000:3.0:1788918607.258405:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855177728 00000100:00080000:2.0:1788918607.258448:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918607.258474:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:3.0:1788918607.258483:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:0:x1875816855177728:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788918607.258508:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918607.258534:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e574e0b/0x2811b8b2b0ac96e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f05c2 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788918607.258579:0:6909:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788918607.258598:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=309s v=(0 0) 00010000:00010000:3.0:1788918607.258602:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918607.258612:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e574e0b/0x2811b8b2b0ac96e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c2 expref: 7 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.258632:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e574e0b/0x2811b8b2b0ac96e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c2 expref: 7 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.258646:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4c00, rc 0) 00000100:00100000:3.0:1788918607.258857:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+7:0:x1875816855177728:12345-192.168.202.49@tcp:101:bash.0 Request processed in 374us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918607.258864:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:2.0:1788918607.261831:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.261889:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855177856 00000100:00100000:3.0:1788918607.261905:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855177856 00000100:00100000:3.0:1788918607.262004:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:3.0:1788918607.262014:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+7:11270:x1875816855177856:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788918607.262061:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918607.262079:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f05c9 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.262110:0:6911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e574e0b/0x2811b8b2b0ac96e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c2 expref: 8 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.262137:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918607.262141:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918607.262147:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 8 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.262183:0:6911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e574e0b/0x2811b8b2b0ac96e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c2 expref: 8 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.262196:0:6911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e574e0b/0x2811b8b2b0ac96e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c2 expref: 8 pid: 6909 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918607.262210:0:6911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1875816865669504:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918607.262296:0:6911:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a89cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918607.265401:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.265480:0:6911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1875816865669504:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918607.265524:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 8 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.265553:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4600, rc 0) 00000100:00100000:3.0:1788918607.265688:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+8:11270:x1875816855177856:12345-192.168.202.49@tcp:101:bash.0 Request processed in 3673us (3865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918607.265697:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:0.0:1788918607.265832:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855177984 00000100:00100000:0.0:1788918607.265839:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855177984 00010000:00010000:0.0:1788918607.265874:0:8796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e574e0b/0x2811b8b2b0ac96e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c2 expref: 8 pid: 6909 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918607.265922:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:0.0:1788918607.265932:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+8:2349:x1875816855177984:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918607.265949:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918607.265969:0:8796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e574e0b/0x2811b8b2b0ac96e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c2 expref: 8 pid: 6909 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918607.265983:0:8796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e574e0b/0x2811b8b2b0ac96e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c2 expref: 8 pid: 6909 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918607.266005:0:8796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e574e0b/0x2811b8b2b0ac96e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c2 expref: 8 pid: 6909 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918607.266059:0:8796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918607.266064:0:8796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918607.266073:0:8796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918607.266083:0:8796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918607.266120:0:8796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918607.266134:0:8796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d98e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8796:1875816865669632:192.168.202.49@tcp:105: 00000100:00100000:0.0:1788918607.266188:0:8796:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe1f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918607.271788:0:8796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d98e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8796:1875816865669632:192.168.202.49@tcp:105: 00010000:00010000:0.0:1788918607.271818:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918607.271872:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855177984:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 5942us (6477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918607.271883:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:2.0:1788918607.272127:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.272531:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855178240 00000100:00100000:3.0:1788918607.272539:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855178240 00000100:00100000:3.0:1788918607.272623:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:3.0:1788918607.272648:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+17:11270:x1875816855178240:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:1.0:1788918607.274638:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+18:11270:x1875816855178240:12345-192.168.202.49@tcp:35:bash.0 Request processed in 1977us (2497us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788918607.274652:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:2.0:1788918607.348061:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918607.348249:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855178496 00000100:00100000:1.0:1788918607.348260:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855178496 00000100:00100000:1.0:1788918607.348325:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 147 00000100:00100000:1.0:1788918607.348346:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+18:11280:x1875816855178496:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788918607.348376:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918607.348403:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac96f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f05d0 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918607.348523:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788918607.348630:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac96f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05d0 expref: 20 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.348644:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ffff5d1000) 00010000:00010000:1.0:1788918607.348647:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788918607.348653:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac96f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05d0 expref: 20 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.348677:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5600, rc 0) 00000100:00100000:1.0:1788918607.348743:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+19:11280:x1875816855178496:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 410us (734us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1788918607.348750:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 147 00000100:00100000:2.0:1788918607.352711:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918607.352815:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855178752 00000100:00100000:0.0:1788918607.352825:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855178752 00000100:00100000:0.0:1788918607.352882:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00100000:0.0:1788918607.352892:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+19:11280:x1875816855178752:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788918607.353151:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+20:11280:x1875816855178752:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 260us (448us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788918607.353174:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00100000:0.0:1788918607.459625:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918607.460629:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855178880 00000100:00100000:1.0:1788918607.460645:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855178880 00000100:00100000:1.0:1788918607.460743:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 148 00000100:00100000:1.0:1788918607.460753:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+20:11286:x1875816855178880:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788918607.460800:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918607.460823:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f05d7 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.460906:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac9707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.460922:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac9707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.460934:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac9707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918607.460980:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788918607.460983:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788918607.461002:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac9707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.461058:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05d7 expref: 22 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.461081:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac9707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05d7 expref: 21 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.461090:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:1.0:1788918607.461093:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788918607.461098:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4800, rc 0) 00000100:00100000:1.0:1788918607.461177:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+21:11286:x1875816855178880:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 425us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918607.461183:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 148 00000100:00100000:2.0:1788918607.469419:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918607.469563:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855179136 00000100:00100000:1.0:1788918607.469577:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855179136 00000100:00100000:1.0:1788918607.469652:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 149 00000100:00100000:1.0:1788918607.469675:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+21:11286:x1875816855179136:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788918607.469704:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918607.469732:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac970e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f05de expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.469868:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.469885:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.469898:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918607.469910:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788918607.470067:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac970e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05de expref: 24 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.470088:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05de expref: 23 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.470096:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:1.0:1788918607.470099:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788918607.470103:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4600, rc 0) 00000100:00100000:1.0:1788918607.470174:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+23:11286:x1875816855179136:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 502us (766us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788918607.470198:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 149 00000100:00100000:0.0:1788918607.479416:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918607.479454:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.479655:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855179520 00000100:00100000:3.0:1788918607.479680:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855179520 00000100:00100000:3.0:1788918607.479746:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 150 00000100:00100000:3.0:1788918607.479757:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+23:11286:x1875816855179520:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918607.479782:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918607.479804:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac9723 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f05e5 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.479924:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac972a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.479942:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac972a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.479955:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac972a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918607.479968:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788918607.480099:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac9723 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05e5 expref: 26 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.480117:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac972a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05e5 expref: 25 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.480127:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:3.0:1788918607.480129:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788918607.480133:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5600, rc 0) 00000100:00100000:3.0:1788918607.480192:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+25:11286:x1875816855179520:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 437us (736us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788918607.480213:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 150 00000100:00100000:2.0:1788918607.481337:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855179264 00000100:00100000:2.0:1788918607.481347:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855179264 00000100:00100000:2.0:1788918607.481408:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:2.0:1788918607.481417:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5096850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+25:2351:x1875816855179264:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918607.481430:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918607.481448:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9715 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05de expref: 25 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.481464:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:2.0:1788918607.481469:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918607.481532:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5096850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+24:2351:x1875816855179264:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 116us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918607.481539:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:0.0:1788918607.493751:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918607.493836:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855179648 00000100:00100000:2.0:1788918607.493847:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855179648 00000100:00100000:2.0:1788918607.493926:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:2.0:1788918607.493937:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855179648:12345-192.168.202.49@tcp:1:lfs.0 00010000:00010000:2.0:1788918607.493989:0:7258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.494012:0:7258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.494049:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918607.494054:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788918607.494059:0:7258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.494095:0:7258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.494125:0:7258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 7 pid: 6911 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918607.494139:0:7258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5371f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7258:1875816865669760:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788918607.494232:0:7258:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc71e6780 going to sleep for 11 seconds 00000100:00100000:2.0:1788918607.499884:0:7258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5371f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7258:1875816865669760:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918607.499925:0:7258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918607.501601:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.501844:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855179776 00000100:00100000:3.0:1788918607.501853:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855179776 00002000:00100000:3.0:1788918607.501907:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff94ffe8d9ad80 x1875816855179776/t0(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:478/0 lens 504/0 e 0 to 0 dl 1788918618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788918607.501918:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffe8d9ad80 with x1875816855179776 ext(0->12) 00010000:00010000:3.0:1788918607.501927:0:6917:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 8 pid: 6911 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.501943:0:6917:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 8 pid: 6911 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788918607.501950:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94ffe8d9ad80 00000100:00100000:3.0:1788918607.501987:0:6917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:3.0:1788918607.501997:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b921db9-4859-438b-976e-b950f67eace4+8:2349:x1875816855179776:12345-192.168.202.49@tcp:4:lfs.0 00000001:00100000:3.0:1788918607.504570:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00000001:00100000:3.0:1788918607.504584:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00000020:00000080:3.0:1788918607.504588:0:6905:0:(genops.c:885:class_export_put()) final put ffff94ffc2c6c000/9b921db9-4859-438b-976e-b950f67eace4 00000020:00000080:0.0:1788918607.505163:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffc2c6c000/9b921db9-4859-438b-976e-b950f67eace4 for lustre-OST0000 00000020:00000080:0.0:1788918607.505227:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffc2c68000 for lustre-OST0000 00000100:00100000:1.0:1788918607.505603:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b921db9-4859-438b-976e-b950f67eace4+9:2349:x1875816855179776:12345-192.168.202.49@tcp:4:lfs.0 Request processed in 3601us (4004us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788918607.505615:0:6917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00002000:00100000:1.0:1788918607.505627:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff94ffe8d9ad80 x1875816855179776/t4294967305(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:478/0 lens 504/448 e 0 to 0 dl 1788918618 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788918607.505638:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffe8d9ad80 with x1875816855179776 ext(0->12) 00010000:00010000:1.0:1788918607.505649:0:6917:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 9 pid: 6911 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.505667:0:6917:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 9 pid: 6911 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788918607.505675:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94ffe8d9ad80 00010000:00010000:3.0:1788918607.515071:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918607.515798:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.515885:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855179904 00000100:00100000:3.0:1788918607.515894:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855179904 00010000:00010000:3.0:1788918607.515932:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 9 pid: 6911 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918607.515973:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:3.0:1788918607.515998:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+9:2351:x1875816855179904:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918607.516013:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788918607.516061:0:7989:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788918607.516065:0:7989:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788918606 00002000:00010000:3.0:1788918607.516068:0:7989:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788918606 00002000:00010000:3.0:1788918607.516070:0:7989:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788918606 00002000:00010000:3.0:1788918607.516072:0:7989:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788918607.516079:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 9 pid: 6911 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.516093:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 9 pid: 6911 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.516116:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac96eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05c9 expref: 9 pid: 6911 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.516135:0:7989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788918607.516140:0:7989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788918607.516146:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.516155:0:7989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.516196:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918607.516249:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+8:2351:x1875816855179904:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 252us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918607.516266:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 66 00010000:00010000:2.0:1788918607.516711:0:7258:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.516722:0:7258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.516743:0:7258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.516752:0:7258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.516759:0:7258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.516778:0:7258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dcc00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918607.516782:0:7258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.516791:0:7258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.516805:0:7258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.516812:0:7258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040ca50d5/0x2811b8b2b0ac9738 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918607.516867:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855179648:12345-192.168.202.49@tcp:1:lfs.0 Request processed in 22932us (23126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918607.516874:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:0.0:1788918607.525715:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.525883:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855180160 00000100:00100000:3.0:1788918607.525902:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855180160 00000100:00100000:3.0:1788918607.525962:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00100000:3.0:1788918607.525972:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc719a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+24:11286:x1875816855180160:12345-192.168.202.49@tcp:35:lfs.0 00000004:00010000:3.0:1788918607.526074:0:5928:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac972a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05e5 expref: 24 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788918607.526305:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788918607.526354:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788918607.530390:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788918607.530855:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.530879:0:5928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac96cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05bb expref: 28 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.530890:0:5928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.531010:0:5928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac96cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05bb expref: 28 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918607.531192:0:5928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac96cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05bb expref: 28 pid: 11359 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918607.531208:0:5928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5371f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5928:1875816865669888:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788918607.531348:0:5928:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc71e69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918607.544386:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918607.544681:0:5928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5371f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5928:1875816865669888:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918607.544711:0:5928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918607.544933:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855180288 00000100:00100000:1.0:1788918607.544942:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855180288 00010000:00010000:1.0:1788918607.544980:0:8796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac96cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05bb expref: 29 pid: 11359 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918607.545051:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 67 00000100:00100000:1.0:1788918607.545063:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+29:2350:x1875816855180288:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918607.545077:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918607.545084:0:8796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac96cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05bb expref: 29 pid: 11359 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.545115:0:8796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac96cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05bb expref: 29 pid: 11359 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.545135:0:8796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac96cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05bb expref: 29 pid: 11359 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.545150:0:8796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:1.0:1788918607.545155:0:8796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.545165:0:8796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.545173:0:8796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.545195:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918607.545362:0:5928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918607.545380:0:5928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788918607.545528:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788918607.545669:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788918607.545756:0:5928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5928:1875816865670016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788918607.545808:0:5928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918607.545842:0:5928:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd828b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788918607.546070:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865670016 00000100:00100000:2.0:1788918607.546077:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865670016 00000100:00100000:2.0:1788918607.546138:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788918607.546148:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5928:x1875816865670016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788918607.546235:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5928:x1875816865670016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918607.546242:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788918607.546392:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788918607.546504:0:5928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5928:1875816865670016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788918607.546639:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788918607.546693:0:5928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fffc877b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5928:1875816865670144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788918607.546731:0:5928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918607.546771:0:5928:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe1f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788918607.546784:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865670144 00000100:00100000:0.0:1788918607.546787:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865670144 00000100:00100000:0.0:1788918607.546813:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788918607.546820:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5928:x1875816865670144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788918607.546916:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5928:x1875816865670144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 96us (183us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788918607.546922:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788918607.546955:0:5928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fffc877b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5928:1875816865670144:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788918607.546991:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788918607.547038:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918607.547048:0:5928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918607.547056:0:5928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918607.547062:0:5928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dcc00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918607.547067:0:5928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918607.547075:0:5928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918607.547091:0:5928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:0.0:1788918607.547094:0:5928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788918607.547098:0:5928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918607.547116:0:5928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac973f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788918607.547217:0:5928:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788918607.547286:0:5928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788918607.547299:0:5928:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 309828278544ns, next at 310828275779ns, rc = 0 00000001:00080000:0.0:1788918607.547305:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788918607.547326:0:5928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94ffff5d1600) 00010000:00010000:0.0:1788918607.547329:0:5928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788918607.547337:0:5928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac972a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05e5 expref: 33 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918607.547705:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+32:2350:x1875816855180288:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 2643us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918607.547715:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 67 00000100:00100000:0.0:1788918607.547844:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc719a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+31:11286:x1875816855180160:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 21873us (22138us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788918607.547852:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 38 00000020:00080000:0.0:1788918607.547856:0:5928:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788918607.569947:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918607.570193:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855180416 00000100:00100000:1.0:1788918607.570205:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855180416 00000100:00100000:1.0:1788918607.570273:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 151 00000100:00100000:1.0:1788918607.570284:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+31:11286:x1875816855180416:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788918607.570311:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918607.570338:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9746 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f05ec expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.570443:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9746 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05ec expref: 32 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.570460:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9746 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05ec expref: 32 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918607.570482:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:1.0:1788918607.570498:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788918607.570503:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5600, rc 0) 00000100:00100000:1.0:1788918607.570573:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+32:11286:x1875816855180416:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 291us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918607.570581:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 151 00000100:00100000:1.0:1788918607.574518:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.574761:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855180672 00000100:00100000:3.0:1788918607.574776:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855180672 00000100:00100000:3.0:1788918607.574944:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:3.0:1788918607.574955:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+32:11286:x1875816855180672:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788918607.575262:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+33:11286:x1875816855180672:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 308us (758us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788918607.575270:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:0.0:1788918607.721866:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.721965:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855180928 00000100:00100000:3.0:1788918607.721977:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855180928 00000100:00100000:3.0:1788918607.722088:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 152 00000100:00100000:3.0:1788918607.722100:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+33:11296:x1875816855180928:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918607.722131:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918607.722153:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac974d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f05f3 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918607.722252:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788918607.722381:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac974d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05f3 expref: 35 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.722395:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ffff5d1000) 00010000:00010000:3.0:1788918607.722398:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788918607.722403:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac974d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05f3 expref: 35 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.722417:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4600, rc 0) 00000100:00100000:3.0:1788918607.722483:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+34:11296:x1875816855180928:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 386us (628us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788918607.722499:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 152 00000100:00100000:0.0:1788918607.725816:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.725897:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855181056 00000100:00100000:3.0:1788918607.725908:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855181056 00000100:00100000:3.0:1788918607.725970:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 153 00000100:00100000:3.0:1788918607.725993:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+34:11296:x1875816855181056:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:3.0:1788918607.726110:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac975b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726131:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac975b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726146:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac975b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726162:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726169:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726194:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726263:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9769 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726271:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726277:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788918607.726327:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726350:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac975b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726356:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac975b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726362:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac975b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726368:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918607.726373:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac975b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726381:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac975b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726393:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918607.726402:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918607.726407:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac975b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726414:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac975b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726431:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726436:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9762 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726442:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726447:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918607.726450:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726456:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9762 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726463:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94fff4b4eb00) 00010000:00010000:3.0:1788918607.726465:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918607.726468:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9762 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726473:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9762 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726520:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726533:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9769 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726538:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726544:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918607.726547:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726553:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9769 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726561:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918607.726564:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918607.726567:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9769 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.726573:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9769 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918607.726670:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+34:11296:x1875816855181056:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 689us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918607.726678:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 153 00000100:00100000:0.0:1788918607.729115:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918607.729196:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855181312 00000100:00100000:1.0:1788918607.729206:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855181312 00000100:00100000:1.0:1788918607.729272:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:1.0:1788918607.729283:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+34:11296:x1875816855181312:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:1.0:1788918607.729526:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+35:11296:x1875816855181312:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 245us (419us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788918607.729534:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:0.0:1788918607.843152:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.843245:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855181568 00000100:00100000:3.0:1788918607.843254:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855181568 00000100:00100000:3.0:1788918607.843317:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 154 00000100:00100000:3.0:1788918607.843337:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+35:11299:x1875816855181568:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918607.843362:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918607.843397:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9770 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f05fa expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843475:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9777 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843521:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9777 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843534:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9777 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843550:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac977e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843557:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac977e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843563:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac977e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843676:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9785 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843685:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843692:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918607.843700:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788918607.843777:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9777 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843796:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9777 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843803:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9777 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843809:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918607.843814:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9777 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843822:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9777 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843834:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918607.843837:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918607.843843:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9777 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843849:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9777 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843862:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac977e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843867:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac977e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843872:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac977e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843877:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918607.843884:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac977e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843890:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac977e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843897:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94fff4b4eb00) 00010000:00010000:3.0:1788918607.843899:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918607.843902:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac977e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843907:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac977e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843948:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9770 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05fa expref: 38 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843962:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05fa expref: 37 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.843969:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918607.843971:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788918607.843974:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4600, rc 0) 00000100:00100000:3.0:1788918607.844302:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+37:11299:x1875816855181568:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 975us (1159us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788918607.844309:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 154 00000100:00100000:0.0:1788918607.854170:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918607.854254:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855181696 00000100:00100000:3.0:1788918607.854264:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855181696 00000100:00100000:3.0:1788918607.854323:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 155 00000100:00100000:3.0:1788918607.854343:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+37:11299:x1875816855181696:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:3.0:1788918607.854438:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9793 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.854458:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.854471:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.854521:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.854529:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9793 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.854536:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.854543:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918607.854547:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.854556:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9793 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.854568:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918607.854572:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788918607.854576:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9793 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918607.854582:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9793 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918607.854677:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+37:11299:x1875816855181696:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 345us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918607.854686:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 155 00000100:00100000:0.0:1788918607.857289:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918607.857395:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855181952 00000100:00100000:1.0:1788918607.857408:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855181952 00000100:00100000:1.0:1788918607.857467:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:1.0:1788918607.857478:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+37:11299:x1875816855181952:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:1.0:1788918607.857739:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+38:11299:x1875816855181952:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 262us (460us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788918607.857757:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:0.0:1788918608.177998:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918608.178161:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855182208 00000100:00100000:3.0:1788918608.178172:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855182208 00000100:00100000:3.0:1788918608.178259:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 156 00000100:00100000:3.0:1788918608.178271:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+38:11331:x1875816855182208:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:3.0:1788918608.178299:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918608.178323:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac979a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0601 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.178448:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.178464:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.178477:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918608.178697:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788918608.178803:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac979a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0601 expref: 41 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.178824:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0601 expref: 40 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.178833:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918608.178852:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788918608.178856:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4800, rc 0) 00000100:00080000:2.0:1788918608.179179:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918608.180140:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+40:11331:x1875816855182208:12345-192.168.202.49@tcp:101:cat.0 Request processed in 1865us (2145us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788918608.180150:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 156 00000100:00100000:0.0:1788918608.195868:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918608.195931:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918608.196063:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855182592 00000100:00100000:1.0:1788918608.196074:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855182592 00000100:00100000:1.0:1788918608.196143:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:1.0:1788918608.196154:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+40:11331:x1875816855182592:12345-192.168.202.49@tcp:35:cat.0 00000100:00100000:1.0:1788918608.196385:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+41:11331:x1875816855182592:12345-192.168.202.49@tcp:35:cat.0 Request processed in 233us (452us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788918608.196393:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:3.0:1788918608.197388:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855182336 00000100:00100000:3.0:1788918608.197395:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855182336 00000100:00100000:3.0:1788918608.197443:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:3.0:1788918608.197451:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+41:2350:x1875816855182336:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918608.197461:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918608.197491:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0601 expref: 41 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.197510:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918608.197515:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918608.197554:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+40:2350:x1875816855182336:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 104us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918608.197562:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:0.0:1788918608.317010:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918608.317243:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855182848 00000100:00100000:3.0:1788918608.317252:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855182848 00000100:00100000:3.0:1788918608.317312:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 157 00000100:00100000:3.0:1788918608.317331:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+40:11337:x1875816855182848:12345-192.168.202.49@tcp:101:dd.0 00010000:00010000:3.0:1788918608.317356:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918608.317360:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788918608.317385:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac9707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05d7 expref: 40 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.317420:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918608.317425:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918608.317438:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97af lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0608 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.317545:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.317557:0:5926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9785 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05fa expref: 40 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.317567:0:5926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.317597:0:5926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05fa expref: 40 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.317610:0:5926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9785 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05fa expref: 40 pid: 5925 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918608.317635:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefd45500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865670272:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918608.317925:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a89cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918608.333148:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefd45500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865670272:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918608.333186:0:5926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918608.343072:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918608.343510:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855182976 00000100:00100000:1.0:1788918608.343521:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855182976 00010000:00010000:1.0:1788918608.343560:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9785 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05fa expref: 41 pid: 5925 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918608.343608:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00100000:1.0:1788918608.343617:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+41:2350:x1875816855182976:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918608.343632:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918608.343639:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9785 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05fa expref: 41 pid: 5925 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.343653:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05fa expref: 41 pid: 5925 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.343684:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9785 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f05fa expref: 41 pid: 5925 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.343702:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:1.0:1788918608.343720:0:5911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.343731:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.343738:0:5911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.343770:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918608.343828:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+40:2350:x1875816855182976:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 205us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918608.343834:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 68 00010000:00010000:3.0:1788918608.344058:0:5926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.344074:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918608.344092:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788918608.344222:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97af lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0608 expref: 41 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.344238:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0608 expref: 40 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.344246:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918608.344249:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788918608.344252:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4c00, rc 0) 00000100:00100000:3.0:1788918608.344280:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+40:11337:x1875816855182848:12345-192.168.202.49@tcp:101:dd.0 Request processed in 26960us (27279us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788918608.344287:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 157 00000100:00100000:1.0:1788918608.349290:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918608.349390:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855183104 00000100:00100000:2.0:1788918608.349400:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855183104 00000100:00100000:2.0:1788918608.349461:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 158 00000100:00100000:2.0:1788918608.349471:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+40:11337:x1875816855183104:12345-192.168.202.49@tcp:101:dd.0 00010000:00010000:2.0:1788918608.349506:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918608.349542:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac97c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f060f expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.349578:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac97cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.349594:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac97cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.349606:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac97cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.349732:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac97c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f060f expref: 42 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.349750:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac97cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f060f expref: 41 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.349759:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:2.0:1788918608.349761:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788918608.349765:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dde00, rc 0) 00000100:00100000:2.0:1788918608.349817:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+41:11337:x1875816855183104:12345-192.168.202.49@tcp:101:dd.0 Request processed in 348us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918608.349838:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 158 00000100:00100000:0.0:1788918608.357356:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918608.357434:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855183360 00000100:00100000:1.0:1788918608.357446:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855183360 00000100:00100000:1.0:1788918608.357515:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 159 00000100:00100000:1.0:1788918608.357526:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+41:11337:x1875816855183360:12345-192.168.202.49@tcp:36:dd.0 00010000:00010000:1.0:1788918608.357775:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac97d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.357796:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac97d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.357808:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac97d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788918608.357863:0:5924:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1788918608.357886:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000610af380 reply state 00000000260ee71e transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac97d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918608.357923:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788918608.362586:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+44:11337:x1875816855183360:12345-192.168.202.49@tcp:36:dd.0 Request processed in 497us (1139us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788918608.362601:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 159 00000020:00080000:1.0:1788918608.362610:0:5924:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788918608.365819:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac97d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.365846:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac97d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.365853:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac97d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.365859:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918608.365865:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac97d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.365902:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac97d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.365920:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918608.365923:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918608.365929:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac97d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.365936:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0ac97d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.534357:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918608.828526:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918608.828766:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855183488 00000100:00100000:2.0:1788918608.828775:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855183488 00000100:00100000:2.0:1788918608.828976:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 160 00000100:00100000:2.0:1788918608.828987:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+43:11351:x1875816855183488:12345-192.168.202.49@tcp:101:stat.0 00010000:00010000:2.0:1788918608.829065:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918608.829087:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac97d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0616 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.829158:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac97e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.829172:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac97e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.829186:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac97e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.829201:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac97e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.829208:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac97e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.829214:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac97e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.829293:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac97ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.829305:0:11359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0608 expref: 44 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.829313:0:11359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac97ee lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.829364:0:11359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0608 expref: 44 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.829386:0:11359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0608 expref: 44 pid: 5926 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918608.831251:0:11359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc5371f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865670400:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788918608.831387:0:11359:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc71e69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918608.837214:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918608.837595:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855183744 00000100:00100000:0.0:1788918608.837605:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855183744 00000100:00100000:0.0:1788918608.837680:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:0.0:1788918608.837690:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+45:5432:x1875816855183744:12345-192.168.202.49@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788918608.838056:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+46:5432:x1875816855183744:12345-192.168.202.49@tcp:35:ldlm_bl.0 Request processed in 366us (851us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788918608.838064:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:0.0:1788918608.844303:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918608.844425:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855183872 00000100:00100000:2.0:1788918608.844439:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855183872 00010000:00010000:2.0:1788918608.844495:0:8796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0608 expref: 46 pid: 5926 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918608.844538:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:2.0:1788918608.844549:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+46:2350:x1875816855183872:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918608.844566:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918608.844572:0:8796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0608 expref: 46 pid: 5926 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.844586:0:8796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0608 expref: 46 pid: 5926 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.844622:0:8796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:2.0:1788918608.844629:0:8796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac97ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.844641:0:8796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac97ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.844678:0:8796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac97ee lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918608.844699:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918608.845062:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+46:2350:x1875816855183872:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 512us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918608.845071:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 69 00010000:00010000:1.0:1788918608.847472:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac97b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0608 expref: 45 pid: 5926 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918608.847511:0:11359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc5371f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865670400:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918608.847543:0:11359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac97ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.847554:0:11359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac97ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.847559:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac97ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918608.848126:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788918608.848132:0:11359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788918608.848157:0:11359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac97ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848174:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac97ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848186:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac97e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848193:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac97e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848219:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac97e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848226:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918608.848230:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac97e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848238:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac97e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848252:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:1.0:1788918608.848255:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918608.848260:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac97e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848267:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac97e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848279:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac97e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848286:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac97e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848292:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac97e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848297:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dca00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918608.848300:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac97e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848329:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac97e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848338:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94ffff5d1100) 00010000:00010000:1.0:1788918608.848341:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918608.848345:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac97e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848351:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac97e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848392:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac97d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0616 expref: 45 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848406:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac97ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0616 expref: 44 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918608.848414:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:1.0:1788918608.848416:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788918608.848419:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dce00, rc 0) 00000100:00100000:1.0:1788918608.848495:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+44:11351:x1875816855183488:12345-192.168.202.49@tcp:101:stat.0 Request processed in 19510us (19978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918608.848504:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 160 00000100:00100000:0.0:1788918608.969684:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918608.969913:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855184128 00000100:00100000:3.0:1788918608.969923:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855184128 00000100:00100000:3.0:1788918608.969986:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 161 00000100:00100000:3.0:1788918608.969997:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+44:11357:x1875816855184128:12345-192.168.202.49@tcp:36:truncate.0 00010000:00010000:3.0:1788918608.970090:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918608.970118:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac97ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0616 expref: 44 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.970137:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918608.970142:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918608.970303:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.970325:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918608.970333:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788918608.970379:0:5926:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788918608.970394:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c02278c reply state 00000000e5cff037 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918608.970401:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788918608.970487:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+46:11357:x1875816855184128:12345-192.168.202.49@tcp:36:truncate.0 Request processed in 491us (826us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788918608.970494:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 161 00000020:00080000:3.0:1788918608.970499:0:5926:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788918608.973837:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918608.973857:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918608.973866:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918608.973872:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918608.973890:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918608.973900:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918608.973921:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:0.0:1788918608.973925:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918608.973945:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918608.973952:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac97f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918609.241155:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918609.241360:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855184256 00000100:00100000:3.0:1788918609.241371:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855184256 00000100:00100000:3.0:1788918609.241442:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 162 00000100:00100000:3.0:1788918609.241453:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefdded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+45:11371:x1875816855184256:12345-192.168.202.49@tcp:101:stat.0 00010000:00010000:3.0:1788918609.241511:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918609.241537:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac97fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f061d expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241644:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9803 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241660:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9803 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241675:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9803 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241690:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac980a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241709:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac980a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241716:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac980a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241802:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241811:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241817:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918609.241861:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788918609.241865:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918609.241891:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241904:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241912:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9803 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241918:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9803 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241925:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9803 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241942:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918609.241947:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9803 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241956:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9803 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241968:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918609.241972:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918609.241976:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9803 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.241983:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9803 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.242008:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac980a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.242015:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac980a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.242084:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac980a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.242089:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918609.242092:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac980a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.242099:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac980a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.242119:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94fff4b4eb00) 00010000:00010000:3.0:1788918609.242122:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918609.242125:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac980a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.242131:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac980a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.242167:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac97fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f061d expref: 47 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.242181:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f061d expref: 46 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.242189:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918609.242191:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788918609.242194:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4c00, rc 0) 00000100:00100000:3.0:1788918609.242267:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefdded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+46:11371:x1875816855184256:12345-192.168.202.49@tcp:101:stat.0 Request processed in 816us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918609.242276:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 162 00000100:00100000:3.0:1788918609.354784:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918609.354858:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855184512 00000100:00100000:0.0:1788918609.354869:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855184512 00000100:00100000:0.0:1788918609.354981:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 163 00000100:00100000:0.0:1788918609.355003:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+46:11381:x1875816855184512:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918609.355055:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918609.355076:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9818 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0624 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918609.355171:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788918609.355268:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9818 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0624 expref: 48 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918609.355282:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ffff5d1000) 00010000:00010000:0.0:1788918609.355285:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788918609.355290:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9818 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0624 expref: 48 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918609.355304:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21a00, rc 0) 00000100:00100000:0.0:1788918609.355386:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+47:11381:x1875816855184512:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 396us (612us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788918609.355394:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 163 00000100:00100000:0.0:1788918609.361289:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918609.361450:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855184768 00000100:00100000:1.0:1788918609.361462:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855184768 00000100:00100000:1.0:1788918609.361571:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:1.0:1788918609.361582:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc719bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+47:11381:x1875816855184768:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:1.0:1788918609.361966:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc719bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+48:11381:x1875816855184768:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 385us (686us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788918609.361974:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:2.0:1788918609.446400:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918609.446547:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855185024 00000100:00100000:3.0:1788918609.446558:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855185024 00000100:00100000:3.0:1788918609.446623:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 164 00000100:00100000:3.0:1788918609.446634:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+48:11387:x1875816855185024:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788918609.446657:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918609.446677:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9826 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f062b expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.446796:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.446812:0:5925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9811 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f061d expref: 49 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.446821:0:5925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.446854:0:5925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f061d expref: 49 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.446868:0:5925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9811 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f061d expref: 49 pid: 5925 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918609.446881:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865670528:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918609.446992:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a89180 going to sleep for 11 seconds 00000100:00100000:1.0:1788918609.450822:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865670528:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918609.450855:0:5925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918609.453050:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918609.453150:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855185152 00000100:00100000:0.0:1788918609.453159:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855185152 00010000:00010000:0.0:1788918609.453200:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9811 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f061d expref: 50 pid: 5925 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918609.453241:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:0.0:1788918609.453249:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+50:2351:x1875816855185152:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918609.453262:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918609.453269:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9811 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f061d expref: 50 pid: 5925 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918609.453281:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f061d expref: 50 pid: 5925 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918609.453302:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9811 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f061d expref: 50 pid: 5925 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918609.453325:0:7989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:0.0:1788918609.453330:0:7989:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918609.453340:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918609.453348:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918609.453379:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918609.453425:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+49:2351:x1875816855185152:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 176us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918609.453446:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 70 00010000:00010000:3.0:1788918609.453654:0:5925:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.453662:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918609.453680:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788918609.453817:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9826 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f062b expref: 50 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.453834:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f062b expref: 49 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.453849:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918609.453852:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788918609.453854:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4800, rc 0) 00000100:00100000:3.0:1788918609.453883:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+49:11387:x1875816855185024:12345-192.168.202.49@tcp:101:bash.0 Request processed in 7251us (7494us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1788918609.453891:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 164 00000100:00100000:3.0:1788918609.457725:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918609.457829:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855185408 00000100:00100000:1.0:1788918609.457841:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855185408 00000100:00100000:1.0:1788918609.457913:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 165 00000100:00100000:1.0:1788918609.457925:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+49:11387:x1875816855185408:12345-192.168.202.49@tcp:36:bash.0 00010000:00010000:1.0:1788918609.458216:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac983b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.458238:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac983b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.458249:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac983b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788918609.458291:0:5924:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1788918609.458321:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc927658 reply state 000000009d4a696d transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac983b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918609.458329:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788918609.458408:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+52:11387:x1875816855185408:12345-192.168.202.49@tcp:36:bash.0 Request processed in 485us (693us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788918609.458415:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 165 00000020:00080000:1.0:1788918609.458434:0:5924:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788918609.464672:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac983b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.464690:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac983b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.464699:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac983b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.464705:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918609.464710:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac983b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.464718:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac983b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.464736:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918609.464740:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918609.464745:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac983b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.464751:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5000/0x2811b8b2b0ac983b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918609.469744:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918609.469833:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855185536 00000100:00100000:1.0:1788918609.469847:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855185536 00000100:00100000:1.0:1788918609.469913:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 166 00000100:00100000:1.0:1788918609.469923:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+51:11387:x1875816855185536:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788918609.469945:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918609.469966:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9842 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0632 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.470085:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9849 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.470102:0:11359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f062b expref: 52 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.470112:0:11359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9849 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.470147:0:11359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f062b expref: 52 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.470162:0:11359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f062b expref: 52 pid: 5925 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918609.470177:0:11359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865670656:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918609.470284:0:11359:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc531d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788918609.474051:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918609.474148:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855185664 00000100:00100000:0.0:1788918609.474157:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855185664 00010000:00010000:0.0:1788918609.474193:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f062b expref: 53 pid: 5925 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918609.474235:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 71 00000100:00100000:0.0:1788918609.474246:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5097c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+53:2349:x1875816855185664:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918609.474262:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918609.474268:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f062b expref: 53 pid: 5925 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918609.474282:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f062b expref: 53 pid: 5925 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918609.474306:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:0.0:1788918609.474311:0:5909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9849 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918609.474331:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918609.474339:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9849 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918609.474360:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918609.474419:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5097c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+53:2349:x1875816855185664:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 174us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918609.474444:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 71 00010000:00010000:1.0:1788918609.475069:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac982d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f062b expref: 52 pid: 5925 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918609.475103:0:11359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865670656:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918609.475125:0:11359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.475136:0:11359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.475141:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918609.475201:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788918609.475206:0:11359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788918609.475229:0:11359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.475261:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9842 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0632 expref: 52 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.475276:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9849 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0632 expref: 51 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.475284:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:1.0:1788918609.475287:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788918609.475290:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4600, rc 0) 00000100:00100000:1.0:1788918609.475344:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+51:11387:x1875816855185536:12345-192.168.202.49@tcp:101:bash.0 Request processed in 5423us (5612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918609.475352:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 166 00000100:00100000:2.0:1788918609.480230:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918609.480329:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855185920 00000100:00100000:3.0:1788918609.480339:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855185920 00000100:00100000:3.0:1788918609.480393:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:3.0:1788918609.480402:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+51:11387:x1875816855185920:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:3.0:1788918609.480640:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+52:11387:x1875816855185920:12345-192.168.202.49@tcp:35:bash.0 Request processed in 239us (420us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788918609.480648:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 45 00000040:00080000:2.0:1788918609.558219:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788918609.558229:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788918609.558997:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1788918609.559011:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788918609.559612:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918609.576090:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918609.576190:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855186176 00000100:00100000:1.0:1788918609.576201:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855186176 00000100:00100000:1.0:1788918609.576263:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 167 00000100:00100000:1.0:1788918609.576273:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+52:11397:x1875816855186176:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788918609.576297:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918609.576327:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9850 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0639 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918609.576425:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788918609.576536:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9850 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0639 expref: 54 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.576551:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ffff5d1000) 00010000:00010000:1.0:1788918609.576554:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788918609.576559:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9850 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0639 expref: 54 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.576573:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4e00, rc 0) 00000100:00100000:1.0:1788918609.576637:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+53:11397:x1875816855186176:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 366us (557us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788918609.576644:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 167 00000100:00100000:0.0:1788918609.583133:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918609.583454:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855186304 00000100:00100000:3.0:1788918609.583464:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855186304 00000100:00100000:3.0:1788918609.583548:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 168 00000100:00100000:3.0:1788918609.583558:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+53:11397:x1875816855186304:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:3.0:1788918609.583645:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac985e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583674:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac985e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583688:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac985e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583704:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583712:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583744:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583819:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac986c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583828:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583835:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788918609.583885:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583899:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac985e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583905:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac985e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583912:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac985e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583919:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918609.583923:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac985e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583931:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac985e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583944:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918609.583953:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918609.583959:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac985e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583965:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac985e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583981:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583987:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9865 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583993:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.583998:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918609.584001:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.584006:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9865 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.584014:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94fff4b4eb00) 00010000:00010000:3.0:1788918609.584016:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918609.584050:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9865 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.584057:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9865 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.584072:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.584084:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac986c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.584089:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac986c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.584094:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918609.584097:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac986c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.584104:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac986c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.584113:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918609.584115:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918609.584119:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac986c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.584124:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac986c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918609.584204:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+53:11397:x1875816855186304:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 647us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918609.584212:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 168 00000100:00100000:2.0:1788918609.587550:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918609.587595:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855186560 00000100:00100000:3.0:1788918609.587606:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855186560 00000100:00100000:3.0:1788918609.587733:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:3.0:1788918609.587744:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+53:11397:x1875816855186560:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788918609.587996:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+54:11397:x1875816855186560:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 254us (458us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788918609.588016:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:0.0:1788918609.630970:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918609.631063:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855186816 00000100:00100000:1.0:1788918609.631073:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855186816 00000100:00100000:1.0:1788918609.631128:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 169 00000100:00100000:1.0:1788918609.631138:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+54:11400:x1875816855186816:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788918609.631162:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918609.631180:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9873 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0640 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631265:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5a00/0x2811b8b2b0ac987a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631280:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5a00/0x2811b8b2b0ac987a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631292:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5a00/0x2811b8b2b0ac987a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631305:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9881 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631324:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631331:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631436:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac9888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631444:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac9888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631451:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac9888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918609.631459:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788918609.631543:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5a00/0x2811b8b2b0ac987a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631550:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5a00/0x2811b8b2b0ac987a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631564:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5a00/0x2811b8b2b0ac987a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631570:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918609.631575:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5a00/0x2811b8b2b0ac987a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631584:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5a00/0x2811b8b2b0ac987a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631597:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:1.0:1788918609.631601:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918609.631605:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5a00/0x2811b8b2b0ac987a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631612:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5a00/0x2811b8b2b0ac987a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631627:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631634:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9881 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631640:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631644:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918609.631647:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631661:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9881 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631668:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94fff48fc400) 00010000:00010000:1.0:1788918609.631670:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918609.631673:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9881 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631679:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631718:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9873 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0640 expref: 57 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631731:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac9888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0640 expref: 56 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.631739:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:1.0:1788918609.631740:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788918609.631743:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4200, rc 0) 00000100:00100000:1.0:1788918609.631808:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+56:11400:x1875816855186816:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 671us (847us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788918609.631816:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 169 00000100:00100000:2.0:1788918609.637946:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918609.638061:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855186944 00000100:00100000:3.0:1788918609.638071:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855186944 00000100:00100000:3.0:1788918609.638130:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 170 00000100:00100000:3.0:1788918609.638140:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+56:11400:x1875816855186944:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:3.0:1788918609.638205:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9896 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.638222:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.638234:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.638266:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.638274:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.638280:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.638287:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918609.638291:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.638298:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9896 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.638309:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918609.638337:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788918609.638343:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9896 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.638350:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9896 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918609.638413:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+56:11400:x1875816855186944:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 274us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918609.638420:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 170 00000100:00100000:2.0:1788918609.641771:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918609.641864:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855187200 00000100:00100000:0.0:1788918609.641885:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855187200 00000100:00100000:0.0:1788918609.641947:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:0.0:1788918609.641957:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+56:11400:x1875816855187200:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788918609.642205:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+57:11400:x1875816855187200:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 248us (443us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788918609.642213:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:0.0:1788918609.644281:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918609.644401:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855187328 00000100:00100000:3.0:1788918609.644410:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855187328 00000100:00100000:3.0:1788918609.644485:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:3.0:1788918609.644496:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+57:2350:x1875816855187328:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918609.644511:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918609.644536:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4200/0x2811b8b2b0ac9888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0640 expref: 57 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.644556:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918609.644562:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918609.644620:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+56:2350:x1875816855187328:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 125us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918609.644627:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:2.0:1788918609.859169:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918609.859271:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855187584 00000100:00100000:1.0:1788918609.859281:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855187584 00000100:00100000:1.0:1788918609.859354:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 171 00000100:00100000:1.0:1788918609.859365:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+56:11418:x1875816855187584:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:1.0:1788918609.859407:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918609.859428:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac989d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0647 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.859547:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac98a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.859561:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac98a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.859576:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac98a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918609.859586:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788918609.859690:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac989d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0647 expref: 59 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.859708:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac98a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0647 expref: 58 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.859716:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:1.0:1788918609.859719:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788918609.859722:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5400, rc 0) 00000100:00100000:1.0:1788918609.859784:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+58:11418:x1875816855187584:12345-192.168.202.49@tcp:101:cat.0 Request processed in 421us (624us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788918609.859791:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 171 00000100:00100000:2.0:1788918609.894623:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918609.895231:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855187712 00000100:00100000:3.0:1788918609.895242:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855187712 00000100:00100000:3.0:1788918609.895315:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 172 00000100:00100000:3.0:1788918609.895326:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+58:11419:x1875816855187712:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918609.895350:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918609.895385:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f064e expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.895451:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac98b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.895477:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac98b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.895489:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac98b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918609.895528:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788918609.895531:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918609.895548:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac98b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.895572:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f064e expref: 60 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.895591:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac98b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f064e expref: 59 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.895600:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918609.895604:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788918609.895607:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5e00, rc 0) 00000100:00100000:3.0:1788918609.895855:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+59:11419:x1875816855187712:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 530us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918609.895862:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 172 00000100:00100000:2.0:1788918609.901685:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918609.901911:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855188096 00000100:00100000:0.0:1788918609.901922:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855188096 00000100:00100000:0.0:1788918609.901989:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:0.0:1788918609.902000:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+59:11419:x1875816855188096:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788918609.902332:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+60:11419:x1875816855188096:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 332us (654us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788918609.902341:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:0.0:1788918609.905554:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918609.905646:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855188224 00000100:00100000:1.0:1788918609.905654:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855188224 00000100:00100000:1.0:1788918609.905728:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:1.0:1788918609.905754:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefdde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+60:11419:x1875816855188224:12345-192.168.202.49@tcp:103:lfs.0 00010000:00010000:1.0:1788918609.905769:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788918609.905792:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9849 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0632 expref: 60 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.905816:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac98a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0647 expref: 59 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.905828:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9746 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05ec expref: 58 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.905838:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:1.0:1788918609.905843:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918609.905910:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefdde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+57:11419:x1875816855188224:12345-192.168.202.49@tcp:103:lfs.0 Request processed in 158us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918609.905917:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:2.0:1788918609.908640:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918609.908724:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855188352 00000100:00100000:1.0:1788918609.908733:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855188352 00000100:00100000:1.0:1788918609.908789:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 173 00000100:00100000:1.0:1788918609.908798:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+57:11419:x1875816855188352:12345-192.168.202.49@tcp:58:lfs.0 00010000:00010000:1.0:1788918609.908907:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac98c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.908924:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac98c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918609.908936:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac98c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788918609.909069:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788918609.909150:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+57:11419:x1875816855188352:12345-192.168.202.49@tcp:58:lfs.0 Request processed in 352us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918609.909159:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 173 00000100:00100000:2.0:1788918609.950787:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918609.950863:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855188480 00000100:00100000:3.0:1788918609.950893:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855188480 00000100:00100000:3.0:1788918609.950951:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 174 00000100:00100000:3.0:1788918609.950962:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+57:11421:x1875816855188480:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918609.950981:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918609.951001:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0655 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951090:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951104:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951115:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951131:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951138:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951145:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951213:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac98dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951222:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac98dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951229:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac98dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918609.951274:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788918609.951278:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918609.951294:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac98dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951318:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac98dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951326:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951332:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951337:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951342:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918609.951346:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951354:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951364:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918609.951367:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918609.951372:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951379:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951403:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951408:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951413:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951418:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918609.951420:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951426:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951433:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94fff4b4eb00) 00010000:00010000:3.0:1788918609.951436:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918609.951439:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951445:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951485:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0655 expref: 59 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951499:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac98dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0655 expref: 58 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918609.951518:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918609.951520:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788918609.951522:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4c00, rc 0) 00000100:00100000:3.0:1788918609.951584:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+58:11421:x1875816855188480:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 624us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918609.951591:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 174 00000100:00100000:1.0:1788918610.518990:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788918610.519012:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865670784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918610.519099:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918610.519158:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865670784 00000100:00100000:1.0:1788918610.519165:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865670784 00000100:00100000:1.0:1788918610.519222:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788918610.519231:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865670784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918610.519261:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25506368 pending 0 free 3923664896 avail 3692142592 00000100:00100000:1.0:1788918610.519309:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865670784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918610.519316:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788918610.519598:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865670784:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788918610.519641:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788918610.520971:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865670912:0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.521048:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918610.521079:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865671424:0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.521105:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918610.521128:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788918610.521133:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865671040:0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.521153:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918610.521185:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865670912 00000100:00100000:1.0:1788918610.521191:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865670912 00000100:00100000:1.0:1788918610.521244:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788918610.521252:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865670912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.521298:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865670912:12345-0@lo:400:kworker.0 Request processed in 46us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918610.521305:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788918610.521334:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865671424 00000100:00100000:1.0:1788918610.521535:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865671424 00000100:00100000:1.0:1788918610.521583:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865671040 00000100:00100000:1.0:1788918610.521586:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865671040 00000100:00100000:1.0:1788918610.521604:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788918610.521610:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865671424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.521643:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865671424:12345-0@lo:400:kworker.0 Request processed in 33us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918610.521648:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788918610.521659:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788918610.521664:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865671040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.521689:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865671040:12345-0@lo:400:kworker.0 Request processed in 25us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918610.521694:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788918610.521725:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865671296:0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.521751:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918610.521775:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788918610.521780:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865671168:0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.521814:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918610.521839:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865671296 00000100:00100000:1.0:1788918610.521843:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865671296 00000100:00100000:1.0:1788918610.521872:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788918610.521887:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3418:x1875816865671296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.521922:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3418:x1875816865671296:12345-0@lo:400:kworker.0 Request processed in 36us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918610.521928:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788918610.521965:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865671296:0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.521993:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865671040:0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.522001:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865670912:0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.522009:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865671424:0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.522185:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865671168 00000100:00100000:1.0:1788918610.522189:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865671168 00000100:00100000:1.0:1788918610.522212:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788918610.522218:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865671168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918610.522250:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865671168:12345-0@lo:400:kworker.0 Request processed in 32us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918610.522255:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788918610.522278:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865671168:0@lo:400:kworker.0 00000100:00080000:1.0:1788918610.522296:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788918610.522299:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788918610.582195:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788918610.582205:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788918610.582245:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788918610.582258:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788918610.582406:0:12048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff815c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12048:1875816865671552:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788918610.582526:0:12048:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc71e6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918610.589816:0:12048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff815c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12048:1875816865671552:192.168.202.49@tcp:107:hsm_cdtr.0 00010000:00010000:2.0:1788918610.591493:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918610.595652:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918610.595729:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855188608 00000100:00100000:1.0:1788918610.595740:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855188608 00000100:00100000:1.0:1788918610.595830:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 175 00000100:00100000:1.0:1788918610.595841:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+58:11432:x1875816855188608:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788918610.595875:0:5925:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788918610.596007:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+58:11432:x1875816855188608:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 167us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918610.596014:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 175 00000100:00080000:2.0:1788918610.596647:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918610.606016:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.606439:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855188736 00000100:00100000:3.0:1788918610.606450:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855188736 00000100:00100000:3.0:1788918610.606509:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 176 00000100:00100000:3.0:1788918610.606520:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+58:11432:x1875816855188736:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788918610.606594:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98e3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606612:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606624:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606694:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98ea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606702:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606708:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606747:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606757:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606763:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918610.606826:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788918610.606831:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918610.606844:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606855:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98e3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606861:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98e3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606867:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606872:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918610.606877:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98e3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606885:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98e3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606896:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94fffbdf3600) 00010000:00010000:3.0:1788918610.606905:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918610.606912:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606918:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac98e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606931:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606936:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98ea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606941:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606946:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918610.606948:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606953:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98ea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606959:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff94fff4b4eb00) 00010000:00010000:3.0:1788918610.606961:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918610.606964:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98ea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606969:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac98ea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606981:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606990:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.606995:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.607000:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918610.607002:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.607008:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.607016:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918610.607054:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918610.607059:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.607064:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac98f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.607136:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+58:11432:x1875816855188736:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 Request processed in 616us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918610.607145:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 176 00000100:00100000:3.0:1788918610.611929:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918610.612141:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855188992 00000100:00100000:0.0:1788918610.612152:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855188992 00000100:00100000:0.0:1788918610.612212:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 177 00000100:00100000:0.0:1788918610.612224:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+58:11432:x1875816855188992:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788918610.612253:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918610.612273:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac98f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f065c expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.612521:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac98ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.612539:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac98ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.612553:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac98ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918610.612564:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788918610.612645:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac98ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.612653:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac98ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.612660:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac98ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.612667:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918610.612672:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac98ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.612680:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac98ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.612693:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:0.0:1788918610.612700:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788918610.612706:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac98ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.612713:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac98ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.612753:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac98f8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f065c expref: 60 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.612764:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94fffbdf3600) 00010000:00010000:0.0:1788918610.612767:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788918610.612771:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac98f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f065c expref: 60 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.612781:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21800, rc 0) 00000100:00100000:0.0:1788918610.614322:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+59:11432:x1875816855188992:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 2091us (2396us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788918610.614333:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 177 00000100:00100000:1.0:1788918610.647218:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.647296:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855189120 00000100:00100000:3.0:1788918610.647306:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855189120 00000100:00100000:3.0:1788918610.647363:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 178 00000100:00100000:3.0:1788918610.647375:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+59:11432:x1875816855189120:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788918610.647420:0:5924:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788918610.647552:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+59:11432:x1875816855189120:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 179us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918610.647559:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 178 00000100:00100000:2.0:1788918610.653192:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.653248:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855189376 00000100:00100000:3.0:1788918610.653259:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855189376 00000100:00100000:3.0:1788918610.653319:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 179 00000100:00100000:3.0:1788918610.653329:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+59:11432:x1875816855189376:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788918610.653350:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918610.653353:0:11359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788918610.653379:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac98b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f064e expref: 59 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.653400:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918610.653405:0:11359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918610.653419:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac990d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0663 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788918610.653764:0:11359:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788918610.653911:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac9914 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.653926:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac9914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.653938:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac9914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.654179:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac990d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0663 expref: 61 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.654197:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac9914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0663 expref: 60 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.654204:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94fff4b4eb00) 00010000:00010000:3.0:1788918610.654207:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788918610.654209:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4800, rc 0) 00000100:00100000:3.0:1788918610.654319:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+60:11432:x1875816855189376:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 992us (1136us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788918610.654327:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 179 00000100:00100000:2.0:1788918610.670514:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.670949:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855189632 00000100:00100000:3.0:1788918610.670960:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855189632 00000100:00100000:3.0:1788918610.671070:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 180 00000100:00100000:3.0:1788918610.671080:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+60:11432:x1875816855189632:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788918610.671141:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918610.671168:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac9914 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0663 expref: 60 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671189:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94fff4b4eb00) 00010000:00010000:3.0:1788918610.671199:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918610.671220:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9922 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671233:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9922 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671258:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9922 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671296:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9929 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3ae17c45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671304:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ae17c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671312:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ae17c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671360:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9922 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671368:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9922 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671374:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9922 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671380:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918610.671385:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9922 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671393:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9922 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671401:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918610.671404:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918610.671407:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9922 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671420:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9922 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671431:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ae17c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671437:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9929 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ae17c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671443:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9929 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ae17c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671449:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918610.671452:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9929 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ae17c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671468:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9929 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3ae17c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671477:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3ae17c45 (ffff94fff4b4ed00) 00010000:00010000:3.0:1788918610.671479:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918610.671483:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9929 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3ae17c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.671488:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9929 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3ae17c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.671571:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+59:11432:x1875816855189632:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 491us (1066us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788918610.671578:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 180 00000100:00100000:2.0:1788918610.675380:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918610.675484:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855189760 00000100:00100000:1.0:1788918610.675494:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855189760 00000100:00100000:1.0:1788918610.675549:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 181 00000100:00100000:1.0:1788918610.675558:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+59:11432:x1875816855189760:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788918610.675576:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918610.675599:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9930 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f066a expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.675632:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.675646:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.675657:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.675764:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9930 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f066a expref: 61 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.675781:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f066a expref: 60 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.675790:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94fff48fc400) 00010000:00010000:1.0:1788918610.675793:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788918610.675801:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5400, rc 0) 00000100:00100000:1.0:1788918610.675855:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+60:11432:x1875816855189760:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 298us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918610.675862:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 181 00000100:00100000:2.0:1788918610.680351:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.684432:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855190016 00000100:00100000:3.0:1788918610.684449:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855190016 00000100:00100000:3.0:1788918610.684558:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 182 00000100:00100000:3.0:1788918610.684569:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+60:11432:x1875816855190016:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788918610.684658:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac993e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.684676:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac993e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.684689:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac993e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788918610.684860:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788918610.684870:0:5924:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 312965848859ns, next at 313965846261ns, rc = 0 00000004:00010000:3.0:1788918610.684945:0:5924:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eff621ab reply state 0000000038853f05 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac993e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.684957:0:5924:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788918610.685103:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+62:11432:x1875816855190016:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 535us (4762us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788918610.685111:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 182 00000100:00100000:2.0:1788918610.692778:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918610.692865:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855190144 00000100:00100000:1.0:1788918610.692884:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855190144 00000100:00100000:1.0:1788918610.692945:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 183 00000100:00100000:1.0:1788918610.692956:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+62:11432:x1875816855190144:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788918610.692988:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918610.693017:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9945 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0671 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.693094:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9945 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0671 expref: 63 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.693108:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9945 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0671 expref: 63 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.693127:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94fff48fc400) 00010000:00010000:1.0:1788918610.693130:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788918610.693133:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5600, rc 0) 00000100:00100000:1.0:1788918610.693192:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+63:11432:x1875816855190144:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 237us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918610.693199:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 183 00000100:00100000:2.0:1788918610.696331:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.696410:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855190272 00000100:00100000:3.0:1788918610.696420:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855190272 00000100:00100000:3.0:1788918610.696506:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:3.0:1788918610.696517:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2352:x1875816855190272:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788918610.696737:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+7:2352:x1875816855190272:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 222us (413us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788918610.696745:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00080000:2.0:1788918610.696905:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788918610.699385:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac993e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.699401:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac993e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.699409:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac993e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.699414:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918610.699419:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac993e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.699444:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac993e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.699472:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94fff48fc400) 00010000:00010000:0.0:1788918610.699475:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788918610.699481:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac993e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.699487:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac993e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.707247:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918610.707351:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855190528 00000100:00100000:0.0:1788918610.707361:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855190528 00000100:00100000:0.0:1788918610.707419:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:0.0:1788918610.707429:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+62:11432:x1875816855190528:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788918610.707662:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+63:11432:x1875816855190528:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 234us (425us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788918610.707670:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:3.0:1788918610.709945:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918610.710003:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855190784 00000100:00100000:0.0:1788918610.710048:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855190784 00000100:00100000:0.0:1788918610.710102:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 184 00000100:00100000:0.0:1788918610.710112:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+63:11432:x1875816855190784:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788918610.710215:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+63:11432:x1875816855190784:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 104us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918610.710223:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 184 00000100:00100000:2.0:1788918610.730546:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918610.730646:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855190912 00000100:00100000:0.0:1788918610.730665:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855190912 00000100:00100000:0.0:1788918610.730733:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 185 00000100:00100000:0.0:1788918610.730744:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+63:11432:x1875816855190912:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788918610.730767:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918610.730790:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac994c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0678 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.730881:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9953 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.730898:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.730914:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918610.730962:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788918610.730993:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.731063:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac994c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0678 expref: 65 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.731082:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0678 expref: 64 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.731090:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94fff48fc400) 00010000:00010000:0.0:1788918610.731093:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788918610.731097:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21e00, rc 0) 00000100:00100000:0.0:1788918610.731161:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+64:11432:x1875816855190912:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 419us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918610.731173:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 185 00000100:00100000:2.0:1788918610.741297:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918610.741377:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855191040 00000100:00100000:0.0:1788918610.741388:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855191040 00000100:00100000:0.0:1788918610.741442:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:0.0:1788918610.741452:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855191040:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788918610.741481:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918610.741504:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac995a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f067f expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788918610.741530:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0bb51, blocks: 0x0 00010000:00010000:0.0:1788918610.741550:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=313s v=(0 0) 00010000:00010000:0.0:1788918610.741555:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918610.741565:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac995a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f067f expref: 8 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.741598:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac995a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f067f expref: 8 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.741613:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21000, rc 0) 00000100:00100000:0.0:1788918610.741674:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+8:2350:x1875816855191040:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 223us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918610.741683:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:0.0:1788918610.770234:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.770327:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855191296 00000100:00100000:3.0:1788918610.770338:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855191296 00000100:00100000:3.0:1788918610.770400:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 186 00000100:00100000:3.0:1788918610.770411:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefdde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+64:11432:x1875816855191296:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788918610.770524:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefdde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+64:11432:x1875816855191296:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 114us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918610.770530:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 186 00000100:00100000:1.0:1788918610.775992:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.776088:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855191424 00000100:00100000:3.0:1788918610.776099:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855191424 00000100:00100000:3.0:1788918610.776158:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 54 00000100:00100000:3.0:1788918610.776169:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+8:11432:x1875816855191424:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788918610.776190:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918610.776211:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7a58df5/0x2811b8b2b0ac9961 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0686 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.776243:0:6909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac995a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f067f expref: 9 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.776252:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918610.776256:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918610.776262:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a58df5/0x2811b8b2b0ac9961 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0686 expref: 9 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.776298:0:6909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac995a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f067f expref: 9 pid: 6912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.776342:0:6909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac995a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f067f expref: 9 pid: 6912 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.776356:0:6909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6909:1875816865671680:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918610.776448:0:6909:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918610.795041:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918610.795089:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855191552 00000100:00100000:0.0:1788918610.795105:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855191552 00010000:00010000:0.0:1788918610.795146:0:8796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac995a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f067f expref: 10 pid: 6912 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918610.795182:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 72 00000100:00100000:0.0:1788918610.795193:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+10:2350:x1875816855191552:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918610.795208:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918610.795229:0:8796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac995a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f067f expref: 10 pid: 6912 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.795244:0:8796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac995a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f067f expref: 10 pid: 6912 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.795268:0:8796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918610.795272:0:8796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918610.795281:0:8796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7a58df5/0x2811b8b2b0ac9961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0686 expref: 10 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.795292:0:8796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a58df5/0x2811b8b2b0ac9961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0686 expref: 10 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.795346:0:8796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c7a58df5/0x2811b8b2b0ac9961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0686 expref: 10 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918610.795360:0:8796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8796:1875816865671808:192.168.202.49@tcp:105: 00000100:00100000:0.0:1788918610.795442:0:8796:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8eb8300 going to sleep for 11 seconds 00010000:00010000:3.0:1788918610.795610:0:6909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac995a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f067f expref: 10 pid: 6912 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.795626:0:6909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6909:1875816865671680:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918610.795652:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7a58df5/0x2811b8b2b0ac9961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0686 expref: 9 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.795662:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5600, rc 0) 00000100:00100000:3.0:1788918610.795692:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+9:11432:x1875816855191424:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 19525us (19709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918610.795700:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 54 00000100:00100000:0.0:1788918610.799553:0:8796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d9aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8796:1875816865671808:192.168.202.49@tcp:105: 00010000:00010000:0.0:1788918610.799581:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918610.799641:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+8:2350:x1875816855191552:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 4450us (4629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918610.799652:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 72 00000100:00100000:1.0:1788918610.811127:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918610.811167:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855191680 00000100:00100000:1.0:1788918610.811188:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855191680 00002000:00100000:1.0:1788918610.811245:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff94ffff730000 x1875816855191680/t0(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:481/0 lens 504/0 e 0 to 0 dl 1788918621 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788918610.811257:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffff730000 with x1875816855191680 ext(0->8) 00002000:00010000:1.0:1788918610.811262:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffff730000 00000100:00100000:1.0:1788918610.811290:0:6915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:1.0:1788918610.811300:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b921db9-4859-438b-976e-b950f67eace4+8:2350:x1875816855191680:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788918610.813557:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b921db9-4859-438b-976e-b950f67eace4+10:2350:x1875816855191680:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 Request processed in 2248us (2432us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788918610.813572:0:6915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00002000:00100000:1.0:1788918610.813583:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff94ffff730000 x1875816855191680/t4294967314(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:481/0 lens 504/448 e 0 to 0 dl 1788918621 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788918610.813593:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffff730000 with x1875816855191680 ext(0->8) 00002000:00010000:1.0:1788918610.813599:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffff730000 00000100:00100000:3.0:1788918610.820141:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918610.820273:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855191808 00000100:00100000:1.0:1788918610.820285:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855191808 00000100:00100000:1.0:1788918610.820363:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 187 00000100:00100000:1.0:1788918610.820372:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+64:11432:x1875816855191808:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788918610.822411:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1788918610.822423:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1788918610.822486:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:0.0:1788918610.822778:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff489ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865671936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788918610.822841:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918610.822917:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865671936 00000100:00100000:0.0:1788918610.822924:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865671936 00000100:00100000:0.0:1788918610.822965:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788918610.822974:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865671936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788918610.823123:0:6912:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788918610.823127:0:6912:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788918609 00002000:00010000:0.0:1788918610.823129:0:6912:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788918610.823131:0:6912:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788918609 -> 1788918609 00002000:00010000:0.0:1788918610.823133:0:6912:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788918610.823172:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3420:x1875816865671936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 198us (330us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788918610.823180:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:0.0:1788918610.823219:0:3420:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94fff489ca80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788918610.823224:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff489ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865671936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788918610.823497:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788918610.823507:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865672064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788918610.823535:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918610.823561:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865672064 00000100:00100000:3.0:1788918610.823565:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865672064 00000100:00100000:3.0:1788918610.823590:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788918610.823596:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3418:x1875816865672064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788918610.823622:0:7258:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1788918610.823647:0:7258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa0bb4e, atime: 0x6aa0bb4e, ctime: 0x6aa0bb4e, blocks: 0x8 00010000:00010000:3.0:1788918610.823654:0:7258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0ac9968 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.823669:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1788918610.823674:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918610.823680:0:7258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0ac9968 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.823695:0:7258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0ac9968 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.823705:0:7258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0ac9968 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.823712:0:7258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0ac9968 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.823726:0:7258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788918610.823823:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3418:x1875816865672064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 226us (287us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788918610.823830:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00010000:3.0:1788918610.823851:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918610.823857:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0ac9968 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.824438:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918610.824443:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0ac9968 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.824451:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0ac9968 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.824477:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0ac9968 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.824485:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0ac9968 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.824505:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918610.824507:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918610.824509:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788918610.824534:0:3418:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94ffff7f9180/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788918610.824540:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865672064:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1788918610.824989:0:5903:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94ffd828bcc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788918610.824993:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94fff68a9600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94ffd828b540 00000020:00080000:1.0:1788918610.824996:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94fff68a9b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94ffff79d200 00000100:00100000:1.0:1788918610.825143:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+19:11432:x1875816855191808:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 Request processed in 4771us (5012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918610.825149:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 187 00000020:00080000:2.0:1788918610.825497:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788918610.825548:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788918610.828950:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918610.829191:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855191936 00000100:00100000:2.0:1788918610.829201:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855191936 00000100:00100000:2.0:1788918610.829247:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:2.0:1788918610.829257:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+10:2349:x1875816855191936:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788918610.832439:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1788918610.832453:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:2.0:1788918610.833037:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855191936:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 Request processed in 3755us (4070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918610.833050:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:1.0:1788918610.835723:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.835830:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855192192 00000100:00100000:3.0:1788918610.835840:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855192192 00000100:00100000:3.0:1788918610.835900:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 188 00000100:00100000:3.0:1788918610.835910:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+19:11432:x1875816855192192:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788918610.835959:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918610.835983:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9953 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0678 expref: 19 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.836003:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94fff48fc400) 00010000:00010000:3.0:1788918610.836008:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918610.836063:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac996f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.836077:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac996f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.836087:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac996f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788918610.836183:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008310cf1 reply state 000000002415ce82 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac996f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.836189:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788918610.836270:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+20:11432:x1875816855192192:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 362us (615us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788918610.836277:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 188 00010000:00010000:3.0:1788918610.839346:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac996f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.839362:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac996f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.839371:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac996f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.839376:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918610.839382:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac996f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.839397:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac996f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.839412:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94fff48fc400) 00010000:00010000:3.0:1788918610.839415:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918610.839420:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac996f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.839426:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac996f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918610.840006:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.840110:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855192320 00000100:00100000:3.0:1788918610.840120:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855192320 00000100:00100000:3.0:1788918610.840167:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:3.0:1788918610.840176:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855192320:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788918610.840335:0:7258:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788918610.840338:0:7258:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788918609 -> 1788918608 00002000:00010000:3.0:1788918610.840341:0:7258:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788918606 00002000:00010000:3.0:1788918610.840344:0:7258:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788918609 -> 1788918608 00002000:00010000:3.0:1788918610.840346:0:7258:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788918610.840410:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+8:2349:x1875816855192320:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 234us (408us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788918610.840417:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:0.0:1788918610.844655:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.844746:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855192576 00000100:00100000:3.0:1788918610.844754:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855192576 00000100:00100000:3.0:1788918610.844809:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 189 00000100:00100000:3.0:1788918610.844819:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+19:11432:x1875816855192576:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788918610.844902:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.844919:0:11359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9937 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f066a expref: 19 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.844928:0:11359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.844973:0:11359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f066a expref: 19 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.844987:0:11359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f066a expref: 19 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.845002:0:11359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaeaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865672192:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918610.845272:0:11359:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788918610.848309:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.848381:0:11359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaeaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865672192:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918610.848405:0:11359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918610.848633:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855192704 00000100:00100000:0.0:1788918610.848640:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855192704 00010000:00010000:0.0:1788918610.848686:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f066a expref: 20 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918610.848737:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 73 00000100:00100000:0.0:1788918610.848746:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+20:2350:x1875816855192704:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918610.848762:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918610.848768:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f066a expref: 20 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.848780:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f066a expref: 20 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.848801:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f066a expref: 20 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.848814:0:7989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94fff48fc400) 00010000:00010000:0.0:1788918610.848820:0:7989:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.848831:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.848839:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.848877:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918610.848928:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+19:2350:x1875816855192704:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 182us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918610.848936:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 73 00010000:00010000:3.0:1788918610.849189:0:11359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.849198:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.849235:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.849252:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.849259:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.849265:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918610.849269:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.849277:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.849287:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94fff48fc400) 00010000:00010000:3.0:1788918610.849289:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788918610.849293:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.849299:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac9976 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.849352:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+18:11432:x1875816855192576:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 Request processed in 4534us (4704us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788918610.849361:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 189 00000100:00100000:2.0:1788918610.851940:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.852138:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855192832 00000100:00100000:3.0:1788918610.852148:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855192832 00000100:00100000:3.0:1788918610.852232:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:3.0:1788918610.852242:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+8:2350:x1875816855192832:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788918610.852288:0:6911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.852314:0:6911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7a58df5/0x2811b8b2b0ac9961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0686 expref: 8 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.852322:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918610.852327:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788918610.852331:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.852368:0:6911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7a58df5/0x2811b8b2b0ac9961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0686 expref: 8 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.852383:0:6911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7a58df5/0x2811b8b2b0ac9961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0686 expref: 8 pid: 6909 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.852398:0:6911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaeaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6911:1875816865672320:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918610.852480:0:6911:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fb300 going to sleep for 11 seconds 00000100:00100000:3.0:1788918610.855808:0:6911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaeaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6911:1875816865672320:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918610.855839:0:6911:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918610.858822:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918610.859212:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855192960 00000100:00100000:0.0:1788918610.859227:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855192960 00010000:00010000:0.0:1788918610.859265:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a58df5/0x2811b8b2b0ac9961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0686 expref: 9 pid: 6909 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918610.859318:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 74 00000100:00100000:0.0:1788918610.859327:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+9:2349:x1875816855192960:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918610.859342:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918610.859361:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7a58df5/0x2811b8b2b0ac9961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0686 expref: 9 pid: 6909 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.859376:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7a58df5/0x2811b8b2b0ac9961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0686 expref: 9 pid: 6909 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.859398:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7a58df5/0x2811b8b2b0ac9961 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0686 expref: 9 pid: 6909 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.859412:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788918610.859416:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788918610.859423:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.859433:0:5909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.859477:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918610.859538:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+8:2349:x1875816855192960:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 212us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918610.859556:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 74 00010000:00010000:0.0:1788918610.859581:0:6911:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.859591:0:6911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.859609:0:6911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.859618:0:6911:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.859626:0:6911:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.859633:0:6911:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918610.859637:0:6911:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.859646:0:6911:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.859671:0:6911:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.859691:0:6911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ba7515c/0x2811b8b2b0ac997d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918610.859735:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855192832:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 Request processed in 7494us (7803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918610.859743:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:0.0:1788918610.862000:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918610.862183:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855193216 00000100:00100000:2.0:1788918610.862192:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855193216 00000100:00100000:2.0:1788918610.862247:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 190 00000100:00100000:2.0:1788918610.862256:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+18:11432:x1875816855193216:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788918610.862342:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.862359:0:5924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac97cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f060f expref: 18 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.862369:0:5924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.862406:0:5924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac97cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f060f expref: 18 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.862418:0:5924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac97cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f060f expref: 18 pid: 11359 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918610.862431:0:5924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff489c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865672448:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788918610.862529:0:5924:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc71e6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788918610.865408:0:5924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff489c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865672448:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918610.865437:0:5924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918610.866435:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918610.867058:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855193344 00000100:00100000:2.0:1788918610.867067:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855193344 00010000:00010000:2.0:1788918610.867105:0:8796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac97cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f060f expref: 19 pid: 11359 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918610.867140:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 75 00000100:00100000:2.0:1788918610.867150:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+19:2350:x1875816855193344:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918610.867169:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918610.867176:0:8796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac97cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f060f expref: 19 pid: 11359 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.867189:0:8796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac97cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f060f expref: 19 pid: 11359 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.867209:0:8796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac97cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f060f expref: 19 pid: 11359 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.867222:0:8796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:2.0:1788918610.867227:0:8796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.867238:0:8796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.867246:0:8796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.867278:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918610.867336:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+18:2350:x1875816855193344:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 186us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918610.867344:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 75 00010000:00010000:1.0:1788918610.867483:0:5924:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.867492:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.867932:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.867945:0:5924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9945 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0671 expref: 18 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.867953:0:5924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.867982:0:5924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9945 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0671 expref: 18 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.867995:0:5924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9945 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0671 expref: 18 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918610.868116:0:5924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865672576:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918610.868177:0:5924:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc531d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918610.874764:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918610.874793:0:5924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865672576:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918610.874821:0:5924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.875371:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855193472 00000100:00100000:3.0:1788918610.875379:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855193472 00010000:00010000:3.0:1788918610.875416:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9945 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0671 expref: 19 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.875500:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 76 00000100:00100000:3.0:1788918610.875510:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5097450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+19:2350:x1875816855193472:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918610.875526:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918610.875533:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9945 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0671 expref: 19 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.875545:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9945 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0671 expref: 19 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.875568:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0ac9945 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0671 expref: 19 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.875580:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94fff48fc400) 00010000:00010000:3.0:1788918610.875585:0:5911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.875594:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.875602:0:5911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.875633:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918610.875695:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5097450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+18:2350:x1875816855193472:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 186us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918610.875702:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 76 00010000:00010000:2.0:1788918610.875776:0:5924:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.875783:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788918610.875895:0:5924:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788918610.876005:0:5924:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788918610.876068:0:5924:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788918610.876143:0:5924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff489ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5924:1875816865672704:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788918610.878196:0:5924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918610.878236:0:5924:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc71e6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788918610.878306:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865672704 00000100:00100000:3.0:1788918610.878321:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865672704 00000100:00100000:3.0:1788918610.878379:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788918610.878389:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5924:x1875816865672704:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788918610.878493:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5924:x1875816865672704:12345-0@lo:1000:mdt00_000.0 Request processed in 105us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918610.878500:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788918610.878639:0:5924:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788918610.878645:0:5924:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94fff489ca80, transno 4294967315 00000100:00100000:2.0:1788918610.878664:0:5924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff489ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5924:1875816865672704:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788918610.878805:0:5924:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788918610.878867:0:5924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff489ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5924:1875816865672832:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788918610.878897:0:5924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918610.878919:0:5924:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc71e6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788918610.878950:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865672832 00000100:00100000:3.0:1788918610.878955:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865672832 00000100:00100000:3.0:1788918610.878982:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788918610.878988:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5924:x1875816865672832:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788918610.879110:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5924:x1875816865672832:12345-0@lo:1000:mdt00_000.0 Request processed in 121us (211us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788918610.879117:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788918610.879141:0:5924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff489ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5924:1875816865672832:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788918610.879172:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879182:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879189:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879195:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918610.879199:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879207:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879221:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94fff48fc400) 00010000:00010000:1.0:1788918610.879224:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788918610.879228:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879234:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac998b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879260:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac98c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879273:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac98c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879278:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac98c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879283:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918610.879287:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac98c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879293:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac98c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879301:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:1.0:1788918610.879304:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788918610.879306:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac98c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879312:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac98c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879333:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879346:0:5924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac98dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0655 expref: 21 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879355:0:5924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879378:0:5924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac98dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0655 expref: 21 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918610.879397:0:5924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac98dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0655 expref: 21 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918610.879408:0:5924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc37100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865672960:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918610.879480:0:5924:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc531dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918610.883362:0:5924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc37100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865672960:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918610.883395:0:5924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.888771:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918610.888814:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855193600 00000100:00100000:3.0:1788918610.888825:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855193600 00010000:00010000:3.0:1788918610.888868:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac98dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0655 expref: 22 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788918610.896255:0:12805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788918610.896265:0:12805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788918610.896289:0:12805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788918610.896295:0:12805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788918610.896938:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00100000:3.0:1788918610.896959:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+22:2350:x1875816855193600:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918610.896978:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918610.896990:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac98dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0655 expref: 22 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897034:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac98dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0655 expref: 22 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897069:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac98dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0655 expref: 22 pid: 5925 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897085:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918610.897091:0:5909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897101:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897109:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897141:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918610.897202:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+21:2350:x1875816855193600:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 251us (8442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918610.897211:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 77 00010000:00010000:3.0:1788918610.897243:0:5924:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897251:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897262:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897270:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897276:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897287:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918610.897292:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897301:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897310:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918610.897313:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918610.897317:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897323:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9992 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897334:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897341:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897346:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897351:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918610.897355:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897361:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897379:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff48fc100) 00010000:00010000:3.0:1788918610.897381:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788918610.897385:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918610.897391:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9984 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918610.897530:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+20:11432:x1875816855193216:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 35274us (35539us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788918610.897539:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 190 00000020:00080000:3.0:1788918610.897542:0:5924:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788918610.897624:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788918610.897628:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788918610.898114:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788918610.898122:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788918610.901437:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918610.901484:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855193856 00000100:00100000:0.0:1788918610.901494:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855193856 00000100:00100000:0.0:1788918610.901550:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:0.0:1788918610.901560:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5144c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+20:11432:x1875816855193856:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788918610.901814:0:5928:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788918610.901847:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788918610.901886:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9999 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.901902:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9999 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.901923:0:5928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9999 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.901933:0:5928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9999 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.901939:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9999 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.901945:0:5928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9999 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918610.901962:0:5928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788918610.902077:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5144c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+22:11432:x1875816855193856:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 517us (648us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788918610.902085:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 50 00000020:00080000:0.0:1788918610.902090:0:5928:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788918610.902429:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918610.902437:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9999 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.902444:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21a00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918610.902448:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9999 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.904944:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9999 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.904965:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94fff6819f00) 00010000:00010000:2.0:1788918610.904968:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788918610.904975:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9999 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.904982:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9999 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918610.905207:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918610.905210:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918610.905212:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918611.116726:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918611.116960:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855194112 00000100:00100000:1.0:1788918611.116971:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855194112 00000100:00100000:1.0:1788918611.117144:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:1.0:1788918611.117155:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855194112:12345-192.168.202.49@tcp:400:kworker.0 00000100:00080000:2.0:1788918611.119068:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918611.119602:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918611.119950:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918611.119985:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855194240 00000100:00100000:3.0:1788918611.119994:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855194240 00000100:00100000:3.0:1788918611.120065:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 163 00000100:00100000:3.0:1788918611.120075:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855194240:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918611.120247:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855193984 00000100:00100000:2.0:1788918611.120251:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855193984 00000100:00100000:2.0:1788918611.120282:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 296 00000100:00100000:2.0:1788918611.120288:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855193984:12345-192.168.202.49@tcp:400:kworker.0 00000100:00080000:0.0:1788918611.120369:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918611.120587:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2349:x1875816855194240:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 513us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918611.120595:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 163 00000100:00100000:2.0:1788918611.122929:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2349:x1875816855193984:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 2630us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918611.122944:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 296 00000100:00100000:0.0:1788918611.124266:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855194112:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 6861us (7300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918611.124280:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:3.0:1788918611.544576:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865673088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918611.544665:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918611.544814:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865673088 00000100:00100000:0.0:1788918611.544824:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865673088 00000100:00100000:0.0:1788918611.544891:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788918611.544901:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3418:x1875816865673088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788918611.544932:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 28672 free 3923664896 avail 3692142592 00000100:00100000:0.0:1788918611.544987:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3418:x1875816865673088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918611.545003:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788918611.545282:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865673088:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788918611.607342:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918612.631154:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788918612.981804:0:12857:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788918612.981815:0:12857:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788918612.983102:0:12857:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788918612.983111:0:12857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788918613.223648:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918613.226257:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855194496 00000100:00100000:1.0:1788918613.226272:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855194496 00000100:00100000:1.0:1788918613.226513:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 191 00000100:00100000:1.0:1788918613.226525:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+22:11450:x1875816855194496:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788918613.226548:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918613.226568:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac99a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f068d expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918613.226671:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac99a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918613.226700:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac99a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918613.226715:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac99a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918613.226728:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788918613.226845:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac99a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f068d expref: 25 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918613.226875:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac99a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f068d expref: 24 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918613.226884:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:1.0:1788918613.226887:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788918613.226891:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5200, rc 0) 00000100:00100000:1.0:1788918613.226956:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+24:11450:x1875816855194496:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 433us (3316us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788918613.226963:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 191 00000100:00100000:3.0:1788918613.229192:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00080000:0.0:1788918613.230209:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918613.230534:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855194624 00000100:00100000:2.0:1788918613.230546:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855194624 00000100:00100000:2.0:1788918613.230612:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 192 00000100:00100000:2.0:1788918613.230622:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+24:11450:x1875816855194624:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:2.0:1788918613.230799:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.230833:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.230856:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.230943:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac99bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.230952:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac99bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.230960:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac99bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231659:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac99c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231672:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac99c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231681:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac99c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788918613.231796:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac99c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231812:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231819:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231826:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231831:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918613.231854:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231929:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231945:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918613.231948:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918613.231953:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231959:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231971:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac99bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231977:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac99bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231982:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac99bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231987:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918613.231990:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac99bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.231995:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac99bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.232002:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94ffff5d1900) 00010000:00010000:3.0:1788918613.232004:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918613.232012:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac99bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.232432:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac99bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.232461:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac99c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.232468:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac99c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.232474:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac99c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.232479:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918613.232482:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac99c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.232488:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac99c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.232497:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17000) 00010000:00010000:3.0:1788918613.232500:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918613.232503:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac99c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.232509:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac99c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918613.232598:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+24:11450:x1875816855194624:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 1973us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918613.232607:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 192 00000100:00100000:1.0:1788918613.305712:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918613.306386:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855194880 00000100:00100000:3.0:1788918613.306397:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855194880 00000100:00100000:3.0:1788918613.306480:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 193 00000100:00100000:3.0:1788918613.306493:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+24:11454:x1875816855194880:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918613.306516:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918613.306537:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac99ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0694 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.306616:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac99d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.306631:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac99d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.306642:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac99d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.306657:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac99d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.306663:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac99d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.306669:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac99d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.306800:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac99df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.306808:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac99df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.306832:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac99df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918613.306843:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788918613.311617:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac99d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.311636:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac99d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.311644:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac99d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.311651:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918613.311656:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac99d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.311665:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac99d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.311963:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:0.0:1788918613.311968:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918613.311974:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac99d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.311981:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0ac99d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.311999:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac99d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.312005:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac99d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.312061:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac99d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.312066:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918613.312069:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac99d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.312075:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac99d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.312084:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94fffca17000) 00010000:00010000:0.0:1788918613.312086:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918613.312089:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac99d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.312095:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac99d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.312158:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac99ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0694 expref: 27 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.312173:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac99df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0694 expref: 26 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.312181:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17600) 00010000:00010000:0.0:1788918613.312183:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788918613.312186:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4800, rc 0) 00000100:00100000:0.0:1788918613.312255:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+26:11454:x1875816855194880:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 5765us (6553us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788918613.312272:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 193 00000100:00100000:0.0:1788918613.317545:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918613.317631:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855195008 00000100:00100000:3.0:1788918613.317641:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855195008 00000100:00100000:3.0:1788918613.317711:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 194 00000100:00100000:3.0:1788918613.317722:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+26:11454:x1875816855195008:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:3.0:1788918613.317804:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac99ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.317824:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac99ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.317836:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac99ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.318148:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac99ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.318157:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac99ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.318164:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac99ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.318170:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918613.318175:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac99ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.318200:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac99ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.318212:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17600) 00010000:00010000:3.0:1788918613.318215:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788918613.318220:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac99ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.318226:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac99ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918613.318339:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+26:11454:x1875816855195008:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 618us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918613.318346:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 194 00000100:00100000:1.0:1788918613.322513:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918613.322614:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855195264 00000100:00100000:0.0:1788918613.322624:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855195264 00000100:00100000:0.0:1788918613.322680:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:0.0:1788918613.322701:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+26:11454:x1875816855195264:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788918613.324221:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+27:11454:x1875816855195264:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 1516us (1714us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788918613.324232:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:1.0:1788918613.379141:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918613.380156:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855195520 00000100:00100000:2.0:1788918613.380169:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855195520 00000100:00100000:2.0:1788918613.380244:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 195 00000100:00100000:2.0:1788918613.380254:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+27:10979:x1875816855195520:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788918613.380279:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918613.380301:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac99f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f069b expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.380446:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.380463:0:5924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac99df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0694 expref: 28 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.380472:0:5924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.380534:0:5924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac99df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0694 expref: 28 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.380549:0:5924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac99df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0694 expref: 28 pid: 5926 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918613.380566:0:5924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff489dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865673216:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788918613.380675:0:5924:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc71e69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918613.390148:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918613.390316:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855195648 00000100:00100000:0.0:1788918613.390327:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855195648 00010000:00010000:0.0:1788918613.390376:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac99df lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0694 expref: 29 pid: 5926 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918613.390428:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 78 00000100:00100000:0.0:1788918613.390452:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+29:2349:x1875816855195648:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918613.390472:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918613.390480:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac99df lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0694 expref: 29 pid: 5926 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.390496:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac99df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0694 expref: 29 pid: 5926 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.390519:0:7989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17600) 00010000:00010000:0.0:1788918613.390525:0:7989:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.390553:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.390560:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.390581:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918613.390640:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+29:2349:x1875816855195648:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 191us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918613.390647:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 78 00010000:00010000:2.0:1788918613.391317:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac99df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0694 expref: 28 pid: 5926 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918613.391339:0:5924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff489dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865673216:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918613.391363:0:5924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.391373:0:5924:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.391379:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918613.391400:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788918613.391559:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd600/0x2811b8b2b0ac99f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f069b expref: 29 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.391574:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f069b expref: 28 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.391595:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17600) 00010000:00010000:2.0:1788918613.391598:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788918613.391601:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dc600, rc 0) 00000100:00100000:2.0:1788918613.391649:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+28:10979:x1875816855195520:12345-192.168.202.49@tcp:101:bash.0 Request processed in 11395us (12517us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788918613.391656:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 195 00000100:00100000:3.0:1788918613.403862:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918613.404009:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855195776 00000100:00100000:0.0:1788918613.404054:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855195776 00000100:00100000:0.0:1788918613.404123:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 196 00000100:00100000:0.0:1788918613.404135:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+28:10979:x1875816855195776:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788918613.404160:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918613.404183:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9a09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06a2 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.404218:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9a10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.404234:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.404247:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.404376:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9a09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06a2 expref: 30 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.404405:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06a2 expref: 29 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.404414:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17600) 00010000:00010000:0.0:1788918613.404417:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788918613.404421:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20c00, rc 0) 00000100:00100000:0.0:1788918613.404485:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+29:10979:x1875816855195776:12345-192.168.202.49@tcp:101:bash.0 Request processed in 352us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918613.404492:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 196 00000100:00100000:1.0:1788918613.410700:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918613.410783:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855196032 00000100:00100000:0.0:1788918613.410794:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855196032 00000100:00100000:0.0:1788918613.410865:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 197 00000100:00100000:0.0:1788918613.410875:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+29:10979:x1875816855196032:12345-192.168.202.49@tcp:36:bash.0 00010000:00010000:0.0:1788918613.411140:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9a17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.411158:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.411169:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788918613.411212:0:5926:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788918613.411235:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ecccf64 reply state 000000007204d174 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918613.411243:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788918613.411305:0:5926:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788918613.411403:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+33:10979:x1875816855196032:12345-192.168.202.49@tcp:36:bash.0 Request processed in 529us (710us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788918613.411411:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 197 00000020:00080000:0.0:1788918613.411416:0:5926:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788918613.424538:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:2.0:1788918613.424687:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.424702:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9a17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.424711:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9a17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.424717:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918613.424722:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9a17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.424730:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9a17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.424747:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17600) 00010000:00010000:2.0:1788918613.424750:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918613.424755:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9a17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.424761:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21a00/0x2811b8b2b0ac9a17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918613.424876:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855196160 00000100:00100000:0.0:1788918613.424887:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855196160 00000100:00100000:0.0:1788918613.424944:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 198 00000100:00100000:0.0:1788918613.424955:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+32:10979:x1875816855196160:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788918613.424978:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918613.424994:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9a1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06a9 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.425459:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9a1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06a9 expref: 33 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.425475:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9a1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06a9 expref: 33 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.425492:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17600) 00010000:00010000:0.0:1788918613.425494:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788918613.425496:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20200, rc 0) 00000100:00100000:0.0:1788918613.425547:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+33:10979:x1875816855196160:12345-192.168.202.49@tcp:101:bash.0 Request processed in 595us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918613.425555:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 198 00000100:00100000:3.0:1788918613.430886:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918613.431044:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855196288 00000100:00100000:2.0:1788918613.431054:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855196288 00000100:00100000:2.0:1788918613.431181:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:2.0:1788918613.431193:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+7:10979:x1875816855196288:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788918613.431213:0:6912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918613.431234:0:6912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0ac9a25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06b0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788918613.431258:0:6912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa0bb50, atime: 0x6aa0bb4e, ctime: 0x6aa0bb50, blocks: 0x8 00010000:00010000:2.0:1788918613.431293:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=315s v=(0 0) 00010000:00010000:2.0:1788918613.431298:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918613.431306:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0ac9a25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06b0 expref: 8 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.431325:0:6912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0ac9a25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06b0 expref: 8 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.431339:0:6912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd600, rc 0) 00000100:00100000:2.0:1788918613.431401:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+8:10979:x1875816855196288:12345-192.168.202.49@tcp:101:bash.0 Request processed in 211us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918613.431409:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00080000:0.0:1788918613.431477:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788918613.434565:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918613.434655:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855196416 00000100:00100000:3.0:1788918613.434665:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855196416 00002000:00010000:3.0:1788918613.434701:0:6917:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788918613.434706:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffff77d880 with x1875816855196416 ext(0->18446744073709551615) 00002000:00010000:3.0:1788918613.434716:0:6917:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffff77d880. 00000100:00100000:3.0:1788918613.434783:0:6917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:3.0:1788918613.434795:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b921db9-4859-438b-976e-b950f67eace4+8:2349:x1875816855196416:12345-192.168.202.49@tcp:10:bash.0 00002000:00010000:3.0:1788918613.435242:0:6917:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788918613.435247:0:6917:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788918608 -> 1788918612 00002000:00010000:3.0:1788918613.435250:0:6917:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788918606 -> 1788918606 00002000:00010000:3.0:1788918613.435262:0:6917:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788918608 -> 1788918612 00002000:00010000:3.0:1788918613.435265:0:6917:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788918613.435389:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b921db9-4859-438b-976e-b950f67eace4+9:2349:x1875816855196416:12345-192.168.202.49@tcp:10:bash.0 Request processed in 594us (835us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788918613.435397:0:6917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00002000:00010000:3.0:1788918613.435401:0:6917:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788918613.435403:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffff77d880 with x1875816855196416 ext(0->18446744073709551615) 00002000:00010000:3.0:1788918613.435408:0:6917:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffff77d880. 00000100:00100000:1.0:1788918613.567150:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918613.567268:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855196544 00000100:00100000:2.0:1788918613.567288:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855196544 00000100:00100000:2.0:1788918613.567341:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 199 00000100:00100000:2.0:1788918613.567351:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+33:11468:x1875816855196544:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:2.0:1788918613.567448:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9a2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567466:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9a2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567477:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9a2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567494:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567501:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567508:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567577:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567585:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567592:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788918613.567640:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567652:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9a2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567683:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9a2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567689:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567694:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dce00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918613.567699:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567707:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9a2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567720:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:2.0:1788918613.567722:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918613.567727:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9a2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567733:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9a2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567747:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567752:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567758:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567762:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48ddc00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918613.567770:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567778:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567785:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94ffff5d1d00) 00010000:00010000:2.0:1788918613.567788:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918613.567791:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567797:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567811:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567816:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567821:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567826:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dca00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918613.567829:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567834:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567850:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17600) 00010000:00010000:2.0:1788918613.567853:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918613.567864:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.567870:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918613.567947:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+33:11468:x1875816855196544:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 596us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918613.567954:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 199 00000001:00080000:3.0:1788918613.600080:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1788918613.600098:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1788918613.637343:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918613.637698:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855196800 00000100:00100000:3.0:1788918613.637710:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855196800 00000100:00100000:3.0:1788918613.637783:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 200 00000100:00100000:3.0:1788918613.637794:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+33:11471:x1875816855196800:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918613.637816:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918613.637836:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9a41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06b7 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.637932:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9a48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.637947:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9a48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.637961:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9a48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.637975:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9a4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.638002:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.638009:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638257:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638286:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638294:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918613.638307:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788918613.638392:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9a48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638399:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9a48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638406:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9a48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638411:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918613.638416:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9a48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638423:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9a48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638455:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:2.0:1788918613.638458:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918613.638462:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9a48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638468:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9a48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638481:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638486:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9a4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638491:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638496:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918613.638499:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638504:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9a4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638511:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94fffca17800) 00010000:00010000:2.0:1788918613.638513:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918613.638516:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9a4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638521:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9a4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638568:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9a41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06b7 expref: 36 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638582:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06b7 expref: 35 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.638590:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17600) 00010000:00010000:2.0:1788918613.638593:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788918613.638595:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dca00, rc 0) 00000100:00100000:2.0:1788918613.638661:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+35:11471:x1875816855196800:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 868us (1328us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788918613.638668:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 200 00000100:00100000:1.0:1788918613.643066:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918613.647005:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855196928 00000100:00100000:2.0:1788918613.647042:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855196928 00000100:00100000:2.0:1788918613.647119:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 201 00000100:00100000:2.0:1788918613.647132:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff77d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+35:11471:x1875816855196928:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:2.0:1788918613.647208:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.647227:0:5924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f069b expref: 35 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.647237:0:5924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.647286:0:5924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f069b expref: 35 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.647322:0:5924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f069b expref: 35 pid: 5924 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918613.647339:0:5924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff489dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865673344:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788918613.647469:0:5924:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc71e6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788918613.652704:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918613.652859:0:5924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff489dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5924:1875816865673344:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918613.652887:0:5924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918613.658044:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918613.658372:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855197184 00000100:00100000:3.0:1788918613.658385:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855197184 00000100:00100000:3.0:1788918613.658470:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:3.0:1788918613.658480:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+36:5432:x1875816855197184:12345-192.168.202.49@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788918613.658831:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+37:5432:x1875816855197184:12345-192.168.202.49@tcp:35:ldlm_bl.0 Request processed in 350us (6134us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788918613.658914:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:1.0:1788918613.666242:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918613.666346:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855197312 00000100:00100000:3.0:1788918613.666356:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855197312 00010000:00010000:3.0:1788918613.666395:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f069b expref: 37 pid: 5924 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918613.666449:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:3.0:1788918613.666459:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+37:2349:x1875816855197312:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918613.666477:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918613.666485:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f069b expref: 37 pid: 5924 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666499:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f069b expref: 37 pid: 5924 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666538:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac99fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f069b expref: 37 pid: 5924 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666553:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17600) 00010000:00010000:3.0:1788918613.666558:0:5911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666568:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666576:0:5911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666601:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918613.666647:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+36:2349:x1875816855197312:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 189us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918613.666655:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 79 00010000:00010000:3.0:1788918613.666696:0:5924:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666703:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666741:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666748:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666754:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666766:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48ddc00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918613.666771:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666778:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666786:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17600) 00010000:00010000:3.0:1788918613.666788:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788918613.666791:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.666796:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9a64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918613.666834:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff77d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+35:11471:x1875816855196928:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 19705us (23778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918613.667008:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 201 00000100:00100000:1.0:1788918613.670472:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918613.670548:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855197568 00000100:00100000:3.0:1788918613.670559:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855197568 00000100:00100000:3.0:1788918613.670614:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:3.0:1788918613.670624:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+35:11471:x1875816855197568:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788918613.670854:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+36:11471:x1875816855197568:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 231us (391us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788918613.670862:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:1.0:1788918613.761604:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918613.762366:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855197824 00000100:00100000:0.0:1788918613.762390:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855197824 00000100:00100000:0.0:1788918613.762465:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 202 00000100:00100000:0.0:1788918613.762475:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+36:11482:x1875816855197824:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:0.0:1788918613.762500:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918613.762522:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9a6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06be expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762596:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762611:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762623:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762637:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762643:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762649:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762754:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9a80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762763:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762770:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918613.762785:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788918613.762857:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762865:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a72 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762872:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762878:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918613.762882:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762889:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a72 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762901:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:0.0:1788918613.762905:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918613.762909:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762915:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762929:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762935:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762952:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762957:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918613.762960:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762966:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762975:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94fff6819a00) 00010000:00010000:0.0:1788918613.762977:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918613.762979:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.762984:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.763256:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9a6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06be expref: 39 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.763271:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9a80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06be expref: 38 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.763279:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17600) 00010000:00010000:0.0:1788918613.763281:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788918613.763284:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20600, rc 0) 00000100:00100000:0.0:1788918613.763438:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+38:11482:x1875816855197824:12345-192.168.202.49@tcp:101:cat.0 Request processed in 955us (1835us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788918613.763456:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 202 00000100:00100000:1.0:1788918613.768406:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918613.768468:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855198080 00000100:00100000:3.0:1788918613.768480:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855198080 00000100:00100000:3.0:1788918613.768543:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 54 00000100:00100000:3.0:1788918613.768567:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+38:11482:x1875816855198080:12345-192.168.202.49@tcp:35:cat.0 00000100:00100000:3.0:1788918613.769108:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+39:11482:x1875816855198080:12345-192.168.202.49@tcp:35:cat.0 Request processed in 541us (709us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788918613.769116:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 54 00000100:00100000:1.0:1788918613.793458:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918613.794225:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855198336 00000100:00100000:0.0:1788918613.794237:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855198336 00000100:00100000:0.0:1788918613.794407:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 203 00000100:00100000:0.0:1788918613.794418:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+39:11483:x1875816855198336:12345-192.168.202.49@tcp:36:rm.0 00010000:00010000:0.0:1788918613.794493:0:5926:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788918613.794521:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9a1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06a9 expref: 39 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.794542:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9a80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06be expref: 38 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.794553:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9a56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06b7 expref: 37 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.794566:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9a10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06a2 expref: 36 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.794576:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fffca17600) 00010000:00010000:0.0:1788918613.794586:0:5926:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918613.794605:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9a8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.794618:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9a8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.794628:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9a8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.794656:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.794676:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.794682:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.794762:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a9c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.794770:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.794777:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788918613.795010:0:5926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1788918613.795040:0:5926:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 316076019459ns, next at 317075997127ns, rc = 0 00010000:00010000:0.0:1788918613.795088:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9aa3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795097:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795104:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795112:0:5926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9aa3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795130:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9aa3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795136:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795161:0:5926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788918613.795178:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795183:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a9c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795189:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795194:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918613.795198:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795205:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a9c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795215:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff6819b00) 00010000:00010000:0.0:1788918613.795218:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788918613.795221:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a9c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795227:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9a9c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795243:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9a8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795256:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9a8e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795262:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9a8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795268:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918613.795281:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9a8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795287:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9a8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795294:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:0.0:1788918613.795296:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918613.795299:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9a8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.795305:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21e00/0x2811b8b2b0ac9a8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788918613.795314:0:5926:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007534d99f reply state 00000000d54368c0 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918613.795322:0:5926:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788918613.795400:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+37:11483:x1875816855198336:12345-192.168.202.49@tcp:36:rm.0 Request processed in 983us (1952us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788918613.795408:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 203 00010000:00010000:2.0:1788918613.796059:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918613.796068:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.796075:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20a00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918613.796079:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.796086:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.796098:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94fff6819b00) 00010000:00010000:2.0:1788918613.796100:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788918613.796103:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9aa3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.796108:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20a00/0x2811b8b2b0ac9aa3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.796138:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918613.796140:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918613.796142:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918613.800182:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.800199:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.800206:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.800211:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918613.800216:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.800224:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.800242:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94fff6819a00) 00010000:00010000:3.0:1788918613.800245:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918613.800250:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.800256:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21000/0x2811b8b2b0ac9a95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918613.853591:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918613.853706:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855198592 00000100:00100000:2.0:1788918613.853716:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855198592 00000100:00100000:2.0:1788918613.853778:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 204 00000100:00100000:2.0:1788918613.853789:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+36:11489:x1875816855198592:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788918613.853812:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918613.853833:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9aaa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06c5 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.853944:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9ab1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.853960:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9ab1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.853972:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9ab1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.853987:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9ab8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.853993:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9ab8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.854000:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9ab8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788918613.854332:0:11359:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788918613.854483:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9abf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.854493:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.854500:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.854534:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9ab1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.854542:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9ab1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.854549:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9ab1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.854555:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918613.854559:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9ab1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.854567:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9ab1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.854579:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:2.0:1788918613.854582:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918613.854587:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9ab1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.854593:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9ab1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788918613.854618:0:11359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b57e643 reply state 00000000152cf02d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9ab8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918613.854627:0:11359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788918613.854654:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9aaa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06c5 expref: 39 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.854668:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06c5 expref: 38 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.854675:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:2.0:1788918613.854678:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918613.854680:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd800, rc 0) 00000100:00100000:2.0:1788918613.854749:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+39:11489:x1875816855198592:12345-192.168.202.49@tcp:101:bash.0 Request processed in 962us (1168us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788918613.854758:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 204 00000100:00100000:1.0:1788918613.859531:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:2.0:1788918613.859606:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9ab8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.859619:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9ab8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.859627:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9ab8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.859633:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dde00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918613.859638:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9ab8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.859678:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9ab8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.859695:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94ffff5d1d00) 00010000:00010000:2.0:1788918613.859698:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918613.859704:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9ab8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918613.859710:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9ab8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918613.859957:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855198720 00000100:00100000:0.0:1788918613.859966:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855198720 00000100:00100000:0.0:1788918613.860078:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:0.0:1788918613.860090:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2350:x1875816855198720:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788918613.860109:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918613.860126:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9acd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06cc expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788918613.860149:0:6909:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918613.860170:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=316s v=(0 0) 00010000:00010000:0.0:1788918613.860175:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918613.860185:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9acd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06cc expref: 6 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.860205:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9acd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06cc expref: 6 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.860217:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21e00, rc 0) 00000100:00100000:0.0:1788918613.860286:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2350:x1875816855198720:12345-192.168.202.49@tcp:101:bash.0 Request processed in 198us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918613.860293:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00080000:1.0:1788918613.860961:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918613.864323:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918613.864504:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855198848 00000100:00100000:3.0:1788918613.864515:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855198848 00000100:00100000:3.0:1788918613.864586:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00100000:3.0:1788918613.864596:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+6:11489:x1875816855198848:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788918613.864613:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918613.864631:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06d3 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.864661:0:6911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9acd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06cc expref: 7 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.864671:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918613.864675:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918613.864681:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.864715:0:6911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9acd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06cc expref: 7 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.864729:0:6911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9acd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06cc expref: 7 pid: 6909 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918613.864744:0:6911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffae8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1875816865673472:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918613.864893:0:6911:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b350c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918613.869214:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918613.869304:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855198976 00000100:00100000:0.0:1788918613.869313:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855198976 00010000:00010000:0.0:1788918613.869353:0:8796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9acd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06cc expref: 8 pid: 6909 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918613.869397:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:0.0:1788918613.869407:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+8:2349:x1875816855198976:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918613.869449:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918613.869471:0:8796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9acd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06cc expref: 8 pid: 6909 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.869486:0:8796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9acd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06cc expref: 8 pid: 6909 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.869509:0:8796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918613.869513:0:8796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918613.869522:0:8796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 8 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.869531:0:8796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 8 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918613.869570:0:8796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 8 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918613.869584:0:8796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8796:1875816865673600:192.168.202.49@tcp:105: 00000100:00100000:0.0:1788918613.869676:0:8796:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b540 going to sleep for 11 seconds 00010000:00010000:3.0:1788918613.871156:0:6911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9acd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06cc expref: 8 pid: 6909 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918613.871179:0:6911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffae8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6911:1875816865673472:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918613.871220:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 7 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918613.871236:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4600, rc 0) 00000100:00100000:3.0:1788918613.871392:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+7:11489:x1875816855198848:12345-192.168.202.49@tcp:101:bash.0 Request processed in 6796us (7076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918613.871401:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00100000:0.0:1788918613.875082:0:8796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8796:1875816865673600:192.168.202.49@tcp:105: 00010000:00010000:0.0:1788918613.875110:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918613.875167:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855198976:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 5761us (5963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918613.875178:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:1.0:1788918613.879224:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918613.879336:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855199232 00000100:00100000:0.0:1788918613.879346:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855199232 00000100:00100000:0.0:1788918613.879405:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:0.0:1788918613.879416:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+38:11489:x1875816855199232:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:0.0:1788918613.879722:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+39:11489:x1875816855199232:12345-192.168.202.49@tcp:35:bash.0 Request processed in 308us (507us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788918613.879730:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:2.0:1788918614.096248:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918614.096319:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855199360 00000100:00100000:3.0:1788918614.096327:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855199360 00000100:00100000:3.0:1788918614.096374:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 205 00000100:00100000:3.0:1788918614.096381:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+39:11505:x1875816855199360:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918614.096400:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918614.096417:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9adb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06da expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.096478:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9ae2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.096489:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.096506:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918614.096541:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788918614.096544:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918614.096556:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.096589:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9adb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06da expref: 41 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.096603:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06da expref: 40 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.096609:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918614.096611:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788918614.096614:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5e00, rc 0) 00000100:00100000:3.0:1788918614.096665:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+40:11505:x1875816855199360:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 284us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918614.096672:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 205 00000100:00100000:2.0:1788918614.102743:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918614.102824:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855199616 00000100:00100000:3.0:1788918614.102836:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855199616 00000100:00100000:3.0:1788918614.102894:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 206 00000100:00100000:3.0:1788918614.102905:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+40:11505:x1875816855199616:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918614.102927:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918614.102948:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9ae9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06e1 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.103093:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9af0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.103108:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.103119:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918614.103139:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788918614.103228:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0ac9ae9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06e1 expref: 43 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.103241:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9af0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06e1 expref: 42 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.103247:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:3.0:1788918614.103249:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788918614.103252:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5600, rc 0) 00000100:00100000:3.0:1788918614.103308:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+42:11505:x1875816855199616:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 406us (576us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788918614.103313:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 206 00000100:00100000:1.0:1788918614.107899:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918614.108005:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918614.108121:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855199872 00000100:00100000:3.0:1788918614.108132:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855199872 00000100:00100000:3.0:1788918614.108193:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 207 00000100:00100000:3.0:1788918614.108203:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+42:11505:x1875816855199872:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918614.108228:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918614.108251:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac9afe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06e8 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.108354:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9b05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.108370:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9b05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.108397:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9b05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918614.108412:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788918614.108529:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0ac9afe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06e8 expref: 45 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.108550:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9b05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06e8 expref: 44 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.108559:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:3.0:1788918614.108562:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788918614.108566:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0030000, rc 0) 00000100:00100000:3.0:1788918614.108620:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+44:11505:x1875816855199872:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 418us (615us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788918614.108627:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 207 00000100:00100000:0.0:1788918614.113538:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855200000 00000100:00100000:0.0:1788918614.113555:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855200000 00000100:00100000:0.0:1788918614.113639:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:0.0:1788918614.113650:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+44:2349:x1875816855200000:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918614.113676:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918614.113702:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0ac9af0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06e1 expref: 44 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.113727:0:7989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:0.0:1788918614.113733:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918614.113795:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+43:2349:x1875816855200000:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 146us (5964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918614.113803:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:1.0:1788918614.116124:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918614.116219:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855200128 00000100:00100000:0.0:1788918614.116228:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855200128 00000100:00100000:0.0:1788918614.116282:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:0.0:1788918614.116294:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+6:2349:x1875816855200128:12345-192.168.202.49@tcp:1:lfs.0 00010000:00010000:0.0:1788918614.116341:0:6909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.116374:0:6909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 6 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.116383:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918614.116387:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788918614.116391:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.116424:0:6909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 6 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.116448:0:6909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 6 pid: 6911 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918614.116463:0:6909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6909:1875816865673728:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918614.116611:0:6909:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788918614.120138:0:6909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6909:1875816865673728:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918614.120167:0:6909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918614.122177:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918614.122282:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855200256 00000100:00100000:0.0:1788918614.122291:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855200256 00002000:00100000:0.0:1788918614.122344:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff94ffff847100 x1875816855200256/t0(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:485/0 lens 504/0 e 0 to 0 dl 1788918625 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788918614.122372:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffff847100 with x1875816855200256 ext(0->8) 00010000:00010000:0.0:1788918614.122382:0:6915:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 7 pid: 6911 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.122398:0:6915:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 7 pid: 6911 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788918614.122406:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94ffff847100 00000100:00100000:0.0:1788918614.122448:0:6915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:0.0:1788918614.122457:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855200256:12345-192.168.202.49@tcp:4:lfs.0 00000100:00100000:0.0:1788918614.124754:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b921db9-4859-438b-976e-b950f67eace4+9:2350:x1875816855200256:12345-192.168.202.49@tcp:4:lfs.0 Request processed in 2287us (2575us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788918614.124768:0:6915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 3 00002000:00100000:0.0:1788918614.124782:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff94ffff847100 x1875816855200256/t4294967308(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:485/0 lens 504/448 e 0 to 0 dl 1788918625 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788918614.124793:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffff847100 with x1875816855200256 ext(0->8) 00010000:00010000:0.0:1788918614.124805:0:6915:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 9 pid: 6911 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.124824:0:6915:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 9 pid: 6911 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788918614.124831:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94ffff847100 00000100:00100000:1.0:1788918614.127846:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918614.127988:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855200384 00000100:00100000:2.0:1788918614.127999:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855200384 00010000:00010000:2.0:1788918614.128070:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 9 pid: 6911 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918614.128114:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00100000:2.0:1788918614.128125:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+9:2350:x1875816855200384:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918614.128139:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788918614.128158:0:5909:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788918614.128161:0:5909:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788918612 00002000:00010000:2.0:1788918614.128164:0:5909:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788918612 00002000:00010000:2.0:1788918614.128166:0:5909:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788918612 00002000:00010000:2.0:1788918614.128168:0:5909:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788918614.128187:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 9 pid: 6911 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.128201:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 9 pid: 6911 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.128223:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0ac9ad4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06d3 expref: 9 pid: 6911 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.128241:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788918614.128245:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788918614.128250:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.128260:0:5909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.128305:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918614.128371:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff844000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+8:2350:x1875816855200384:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 248us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918614.128378:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 81 00010000:00010000:0.0:1788918614.128726:0:6909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.128743:0:6909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.128765:0:6909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.128774:0:6909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.128781:0:6909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.128789:0:6909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21c00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918614.128793:0:6909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.128802:0:6909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.128813:0:6909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.128820:0:6909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048c73acd/0x2811b8b2b0ac9b13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918614.128911:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855200128:12345-192.168.202.49@tcp:1:lfs.0 Request processed in 12620us (12795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918614.128920:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:1.0:1788918614.132725:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918614.132918:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855200640 00000100:00100000:0.0:1788918614.132928:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855200640 00000100:00100000:0.0:1788918614.132983:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00100000:0.0:1788918614.132993:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5145050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+43:11505:x1875816855200640:12345-192.168.202.49@tcp:35:lfs.0 00000004:00010000:0.0:1788918614.133090:0:5928:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9b05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06e8 expref: 43 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788918614.133279:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788918614.133315:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788918614.133608:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788918614.133644:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.133670:0:5928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9abf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06c5 expref: 47 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.133679:0:5928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.133713:0:5928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06c5 expref: 47 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.133727:0:5928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9abf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06c5 expref: 47 pid: 11359 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918614.133761:0:5928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5928:1875816865673856:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918614.134239:0:5928:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788918614.138997:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918614.139187:0:5928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5928:1875816865673856:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918614.139216:0:5928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918614.139461:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855200768 00000100:00100000:1.0:1788918614.139468:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855200768 00010000:00010000:1.0:1788918614.139507:0:8796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9abf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06c5 expref: 48 pid: 11359 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918614.139546:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 82 00000100:00100000:1.0:1788918614.139555:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5097850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+48:2349:x1875816855200768:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918614.139568:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918614.139575:0:8796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9abf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06c5 expref: 48 pid: 11359 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.139587:0:8796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06c5 expref: 48 pid: 11359 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.139607:0:8796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9abf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06c5 expref: 48 pid: 11359 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.139622:0:8796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:1.0:1788918614.139640:0:8796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.139649:0:8796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.139657:0:8796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.139699:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918614.139753:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5097850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9b921db9-4859-438b-976e-b950f67eace4+47:2349:x1875816855200768:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 198us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918614.139761:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 82 00010000:00010000:0.0:1788918614.139935:0:5928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.139943:0:5928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788918614.140088:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788918614.140209:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788918614.140318:0:5928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5928:1875816865673984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788918614.140361:0:5928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918614.140391:0:5928:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918614.140503:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865673984 00000100:00100000:3.0:1788918614.140509:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865673984 00000100:00100000:3.0:1788918614.140560:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788918614.140567:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5928:x1875816865673984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788918614.140648:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5928:x1875816865673984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918614.140655:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788918614.141394:0:5928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1788918614.141401:0:5928:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1788918614.141417:0:5928:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94ffff7f9180, transno 4294967307 00000100:00100000:0.0:1788918614.141442:0:5928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5928:1875816865673984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788918614.141560:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788918614.141609:0:5928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5928:1875816865674112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788918614.141646:0:5928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918614.141831:0:5928:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b9c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788918614.141985:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788918614.142047:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865674112 00000100:00100000:2.0:1788918614.142052:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865674112 00000100:00100000:2.0:1788918614.142089:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788918614.142097:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5928:x1875816865674112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788918614.142215:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5928:x1875816865674112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 119us (568us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788918614.142234:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788918614.142379:0:5928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5928:1875816865674112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788918614.142422:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788918614.142467:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.142477:0:5928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.142484:0:5928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.142490:0:5928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918614.142495:0:5928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.142503:0:5928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.142527:0:5928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:1.0:1788918614.142530:0:5928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788918614.142535:0:5928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.142542:0:5928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20c00/0x2811b8b2b0ac9b1a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788918614.142633:0:5928:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788918614.142701:0:5928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788918614.142712:0:5928:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316423691698ns, next at 317423689556ns, rc = 0 00000001:00080000:1.0:1788918614.142718:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788918614.142739:0:5928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:1.0:1788918614.142742:0:5928:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788918614.142748:0:5928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9b05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06e8 expref: 51 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918614.143202:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5145050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+50:11505:x1875816855200640:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 10209us (10484us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788918614.143210:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 56 00000020:00080000:1.0:1788918614.143214:0:5928:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788918614.148845:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918614.148922:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855200896 00000100:00100000:3.0:1788918614.148934:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855200896 00000100:00100000:3.0:1788918614.148996:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 208 00000100:00100000:3.0:1788918614.149007:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+50:11505:x1875816855200896:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918614.149086:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918614.149109:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac9b21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06ef expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.149169:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac9b21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06ef expref: 51 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.149184:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac9b21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06ef expref: 51 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.149205:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:3.0:1788918614.149208:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788918614.149213:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0030800, rc 0) 00000100:00100000:3.0:1788918614.149260:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+51:11505:x1875816855200896:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 256us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918614.149379:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 208 00000100:00100000:3.0:1788918614.153900:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918614.154913:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855201152 00000100:00100000:2.0:1788918614.154926:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855201152 00000100:00100000:2.0:1788918614.154982:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:2.0:1788918614.154999:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+51:11505:x1875816855201152:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:2.0:1788918614.155238:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+52:11505:x1875816855201152:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 248us (1348us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788918614.155245:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:2.0:1788918614.282998:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918614.283129:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855201280 00000100:00100000:3.0:1788918614.283140:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855201280 00000100:00100000:3.0:1788918614.283204:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 209 00000100:00100000:3.0:1788918614.283215:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+52:11515:x1875816855201280:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:3.0:1788918614.283307:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9b28 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283324:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9b28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283335:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9b28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283366:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9b2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283373:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283381:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283462:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283470:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283477:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788918614.283524:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283538:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9b28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283545:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9b28 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283552:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9b28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283558:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918614.283563:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9b28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283577:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9b28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283590:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918614.283593:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918614.283599:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9b28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283605:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9b28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283618:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283624:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9b2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283629:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9b2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283634:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918614.283636:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9b2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283642:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9b2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283649:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94fffca17100) 00010000:00010000:3.0:1788918614.283651:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918614.283653:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9b2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283669:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9b2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283684:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283690:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283694:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283698:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918614.283701:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283706:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283713:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:3.0:1788918614.283715:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918614.283717:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.283723:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918614.283792:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+52:11515:x1875816855201280:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 579us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918614.283799:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 209 00000100:00100000:3.0:1788918614.334013:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918614.334153:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855201536 00000100:00100000:0.0:1788918614.334176:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855201536 00000100:00100000:0.0:1788918614.334241:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 210 00000100:00100000:0.0:1788918614.334252:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+52:11518:x1875816855201536:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918614.334273:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918614.334306:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9b3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06f6 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334384:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9b44 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334399:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9b44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334412:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9b44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334437:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334445:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334451:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334571:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9b52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334580:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334588:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918614.334604:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788918614.334694:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9b44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334702:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9b44 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334708:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9b44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334714:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918614.334718:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9b44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334725:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9b44 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334736:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:0.0:1788918614.334740:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918614.334745:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9b44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334751:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9b44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334763:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334768:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334784:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334789:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918614.334792:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334797:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334804:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94fff6819200) 00010000:00010000:0.0:1788918614.334807:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918614.334809:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334815:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334857:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9b3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06f6 expref: 55 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334871:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9b52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06f6 expref: 54 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.334878:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:0.0:1788918614.334880:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788918614.334882:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21800, rc 0) 00000100:00100000:0.0:1788918614.334947:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+54:11518:x1875816855201536:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 698us (945us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788918614.334963:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 210 00000100:00100000:0.0:1788918614.338729:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918614.338992:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855201664 00000100:00100000:3.0:1788918614.339002:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855201664 00000100:00100000:2.0:1788918614.339505:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 211 00000100:00100000:2.0:1788918614.339516:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+54:11518:x1875816855201664:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:2.0:1788918614.339585:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9b60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.339602:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.339614:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.339650:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.340152:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9b60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.340163:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9b60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.340184:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918614.340189:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9b60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.340197:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9b60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.340208:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:2.0:1788918614.340211:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788918614.340216:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9b60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.340222:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9b60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918614.340413:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+54:11518:x1875816855201664:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 898us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918614.340421:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 211 00000100:00100000:2.0:1788918614.344553:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918614.345448:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855201920 00000100:00100000:3.0:1788918614.345459:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855201920 00000100:00100000:3.0:1788918614.345518:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:3.0:1788918614.345527:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+54:11518:x1875816855201920:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788918614.345767:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+55:11518:x1875816855201920:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 240us (1222us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788918614.345782:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:3.0:1788918614.443754:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918614.444069:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855202176 00000100:00100000:0.0:1788918614.444081:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855202176 00000100:00100000:0.0:1788918614.444145:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 212 00000100:00100000:0.0:1788918614.444156:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+55:11528:x1875816855202176:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788918614.444180:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918614.444184:0:5925:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788918614.444213:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0ac9ae2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06da expref: 55 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.444235:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:0.0:1788918614.444241:0:5925:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918614.444256:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9b67 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f06fd expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.444376:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.444391:0:5925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9b52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06f6 expref: 55 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.444400:0:5925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.444442:0:5925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9b52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06f6 expref: 55 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.444473:0:5925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9b52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06f6 expref: 55 pid: 5925 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918614.444490:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865674240:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918614.444605:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788918614.450102:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865674240:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918614.450135:0:5925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918614.452418:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918614.452641:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855202304 00000100:00100000:0.0:1788918614.452651:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855202304 00010000:00010000:0.0:1788918614.452708:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9b52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06f6 expref: 56 pid: 5925 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918614.452751:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 83 00000100:00100000:0.0:1788918614.452761:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+56:2350:x1875816855202304:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918614.453088:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918614.453097:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9b52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06f6 expref: 56 pid: 5925 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.453109:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9b52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06f6 expref: 56 pid: 5925 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.453132:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9b52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06f6 expref: 56 pid: 5925 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.453167:0:7989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:0.0:1788918614.453172:0:7989:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.453182:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.453190:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.453217:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918614.453280:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+55:2350:x1875816855202304:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 520us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918614.453288:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 83 00010000:00010000:3.0:1788918614.453670:0:5925:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.453679:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918614.453698:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788918614.453844:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9b67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06fd expref: 56 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.453860:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06fd expref: 55 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.453867:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:3.0:1788918614.453870:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788918614.453872:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21400, rc 0) 00000100:00100000:3.0:1788918614.453913:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+55:11528:x1875816855202176:12345-192.168.202.49@tcp:101:bash.0 Request processed in 9759us (10170us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788918614.453928:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 212 00000100:00100000:3.0:1788918614.458876:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918614.458972:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855202432 00000100:00100000:1.0:1788918614.458982:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855202432 00000100:00100000:1.0:1788918614.459093:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 213 00000100:00100000:1.0:1788918614.459104:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+55:11528:x1875816855202432:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788918614.459126:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918614.459150:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9b7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0704 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.459204:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9b83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.459218:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.459229:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.459346:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9b7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0704 expref: 57 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.459365:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0704 expref: 56 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.459375:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:1.0:1788918614.459378:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788918614.459382:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4e00, rc 0) 00000100:00100000:1.0:1788918614.459454:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+56:11528:x1875816855202432:12345-192.168.202.49@tcp:101:bash.0 Request processed in 352us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918614.459462:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 213 00000100:00100000:2.0:1788918614.464324:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918614.464641:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855202688 00000100:00100000:3.0:1788918614.464650:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855202688 00000100:00100000:3.0:1788918614.464711:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 214 00000100:00100000:3.0:1788918614.464721:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+56:11528:x1875816855202688:12345-192.168.202.49@tcp:36:bash.0 00010000:00010000:3.0:1788918614.464954:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.464972:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.464985:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788918614.465086:0:11359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788918614.465113:0:11359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009b671ac reply state 00000000fa7b5a3e transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918614.465123:0:11359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788918614.465222:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+59:11528:x1875816855202688:12345-192.168.202.49@tcp:36:bash.0 Request processed in 501us (905us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788918614.465229:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 214 00000020:00080000:3.0:1788918614.465235:0:11359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788918614.467794:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.467812:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.467820:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.467827:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918614.467852:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.467862:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.467879:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:2.0:1788918614.467882:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918614.467887:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.467894:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9b8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918614.472787:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918614.472967:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855202816 00000100:00100000:1.0:1788918614.472977:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855202816 00000100:00100000:1.0:1788918614.473064:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 215 00000100:00100000:1.0:1788918614.473075:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+58:11528:x1875816855202816:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788918614.473101:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918614.473123:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9b91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f070b expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.473232:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.473248:0:5926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06fd expref: 59 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.473257:0:5926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.473304:0:5926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06fd expref: 59 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.473320:0:5926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06fd expref: 59 pid: 5925 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918614.473334:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865674368:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918614.473439:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc531d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918614.478146:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918614.478220:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855202944 00000100:00100000:0.0:1788918614.478230:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855202944 00010000:00010000:0.0:1788918614.478282:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06fd expref: 60 pid: 5925 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918614.478318:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:0.0:1788918614.478329:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+60:2349:x1875816855202944:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918614.478345:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918614.478352:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06fd expref: 60 pid: 5925 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.478366:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06fd expref: 60 pid: 5925 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.478406:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:0.0:1788918614.478412:0:5910:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.478432:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.478441:0:5910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.478461:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788918614.478605:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9b6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06fd expref: 60 pid: 5925 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918614.478623:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865674368:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918614.478643:0:5926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.478652:0:5926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.478677:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918614.478731:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788918614.478736:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788918614.478755:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.478793:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0ac9b91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f070b expref: 60 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.478808:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f070b expref: 59 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.478816:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:1.0:1788918614.478819:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788918614.478822:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5c00, rc 0) 00000100:00100000:0.0:1788918614.479347:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+59:2349:x1875816855202944:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 1017us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918614.479357:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:1.0:1788918614.479473:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+58:11528:x1875816855202816:12345-192.168.202.49@tcp:101:bash.0 Request processed in 6399us (6703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918614.479480:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 215 00000100:00100000:3.0:1788918614.483476:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918614.483585:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855203200 00000100:00100000:2.0:1788918614.483656:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855203200 00000100:00100000:2.0:1788918614.483921:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:2.0:1788918614.483933:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+58:11528:x1875816855203200:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:2.0:1788918614.484188:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+59:11528:x1875816855203200:12345-192.168.202.49@tcp:35:bash.0 Request processed in 257us (720us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788918614.484197:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:2.0:1788918614.551651:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918614.551742:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855203328 00000100:00100000:3.0:1788918614.551752:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855203328 00000100:00100000:3.0:1788918614.551814:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 216 00000100:00100000:3.0:1788918614.551846:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+59:11534:x1875816855203328:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918614.551870:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918614.551891:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9b9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0712 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.551958:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9ba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.551972:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.551982:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918614.552067:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788918614.552071:0:11359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918614.552091:0:11359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.552116:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9b9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0712 expref: 61 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.552138:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0712 expref: 60 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.552147:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918614.552149:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788918614.552154:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0030a00, rc 0) 00000100:00100000:3.0:1788918614.552213:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+60:11534:x1875816855203328:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 369us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918614.552229:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 216 00000100:00100000:0.0:1788918614.557075:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918614.557203:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855203456 00000100:00100000:2.0:1788918614.557214:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855203456 00000100:00100000:2.0:1788918614.557284:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 217 00000100:00100000:2.0:1788918614.557295:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+60:11534:x1875816855203456:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788918614.557316:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918614.557340:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9bad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0719 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557431:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9bb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557447:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557457:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557473:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557481:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557488:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557564:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9bc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557573:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557580:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918614.557621:0:5924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788918614.557626:0:5924:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918614.557644:0:5924:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557682:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557691:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557698:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9bb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557705:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557710:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918614.557714:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557721:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9bb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557732:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:2.0:1788918614.557735:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918614.557739:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9bb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557746:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9bb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557758:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557764:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9bbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557777:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557782:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dde00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918614.557784:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557790:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9bbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557798:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94ffff5d1d00) 00010000:00010000:2.0:1788918614.557801:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918614.557803:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9bbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557809:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9bbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557841:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9bad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0719 expref: 62 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557854:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0719 expref: 61 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918614.557861:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:2.0:1788918614.557863:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918614.557865:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dce00, rc 0) 00000100:00100000:2.0:1788918614.557928:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+61:11534:x1875816855203456:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 637us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918614.557943:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 217 00000100:00100000:2.0:1788918614.562925:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918614.562974:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918614.563063:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855203840 00000100:00100000:1.0:1788918614.563073:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855203840 00000100:00100000:1.0:1788918614.563134:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:1.0:1788918614.563144:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+61:2349:x1875816855203840:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918614.563159:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918614.563180:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9bc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0719 expref: 61 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918614.563208:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:1.0:1788918614.563213:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918614.563279:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+60:2349:x1875816855203840:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 136us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918614.563286:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:3.0:1788918614.563694:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855203712 00000100:00100000:3.0:1788918614.563700:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855203712 00000100:00100000:3.0:1788918614.563742:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 218 00000100:00100000:3.0:1788918614.563749:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+60:11534:x1875816855203712:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918614.563765:0:11359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918614.563780:0:11359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9bc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0720 expref: -99 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.563883:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.563898:0:11359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f070b expref: 61 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.563906:0:11359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.563936:0:11359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f070b expref: 61 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.563949:0:11359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f070b expref: 61 pid: 5926 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918614.563962:0:11359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffae8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865674496:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918614.564077:0:11359:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd3298900 going to sleep for 11 seconds 00000100:00100000:2.0:1788918614.567886:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918614.568069:0:11359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffae8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865674496:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918614.568109:0:11359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918614.575409:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855203968 00000100:00100000:0.0:1788918614.575431:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855203968 00010000:00010000:0.0:1788918614.575481:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f070b expref: 62 pid: 5926 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918614.575536:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:0.0:1788918614.575546:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+62:2350:x1875816855203968:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918614.575562:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918614.575569:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f070b expref: 62 pid: 5926 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.575582:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f070b expref: 62 pid: 5926 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.575620:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5c00/0x2811b8b2b0ac9b98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f070b expref: 62 pid: 5926 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.575639:0:7989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:0.0:1788918614.575644:0:7989:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.575654:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.575662:0:7989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.576358:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918614.576438:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+61:2350:x1875816855203968:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 892us (8560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918614.576447:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 85 00010000:00010000:3.0:1788918614.578186:0:11359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.578201:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918614.578223:0:11359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788918614.578470:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9bc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0720 expref: 62 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.578490:0:11359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0720 expref: 61 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.578499:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:3.0:1788918614.578501:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788918614.578505:0:11359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0031c00, rc 0) 00000100:00100000:3.0:1788918614.578608:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+61:11534:x1875816855203712:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 14858us (15693us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788918614.578617:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 218 00000100:00100000:2.0:1788918614.582003:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918614.582186:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855204224 00000100:00100000:0.0:1788918614.582195:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855204224 00000100:00100000:0.0:1788918614.582433:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:0.0:1788918614.582445:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+61:11534:x1875816855204224:12345-192.168.202.49@tcp:103:lfs.0 00010000:00010000:0.0:1788918614.582464:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918614.582490:0:5910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030800/0x2811b8b2b0ac9b21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06ef expref: 61 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.582508:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:0.0:1788918614.582514:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918614.582584:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+60:11534:x1875816855204224:12345-192.168.202.49@tcp:103:lfs.0 Request processed in 142us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918614.582592:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:2.0:1788918614.584867:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918614.584946:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855204352 00000100:00100000:3.0:1788918614.584955:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855204352 00000100:00100000:3.0:1788918614.585015:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 219 00000100:00100000:3.0:1788918614.585045:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+60:11534:x1875816855204352:12345-192.168.202.49@tcp:58:lfs.0 00010000:00010000:3.0:1788918614.585152:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9bde lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.585187:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9bde lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918614.585199:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9bde lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788918614.585317:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788918614.585389:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+60:11534:x1875816855204352:12345-192.168.202.49@tcp:58:lfs.0 Request processed in 345us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918614.585397:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 219 00000100:00100000:2.0:1788918614.588864:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918614.588948:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855204480 00000100:00100000:0.0:1788918614.588958:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855204480 00000100:00100000:0.0:1788918614.589015:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 220 00000100:00100000:0.0:1788918614.589060:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+60:11534:x1875816855204480:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918614.589082:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918614.589104:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9be5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0727 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.589160:0:5925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9bde lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.589172:0:5925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9be5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0727 expref: 61 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.589190:0:5925:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9bde lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.589202:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9be5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0727 expref: 61 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.589215:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:0.0:1788918614.589217:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788918614.589221:0:5925:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9be5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0727 expref: 61 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918614.589229:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20200, rc 0) 00000100:00100000:0.0:1788918614.589309:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+61:11534:x1875816855204480:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 253us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918614.589316:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 220 00010000:00010000:1.0:1788918614.686092:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788918614.998250:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788918614.998272:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788918614.998320:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788918614.998329:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788918614.998480:0:12048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffae8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12048:1875816865674624:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788918614.998612:0:12048:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b35480 going to sleep for 11 seconds 00000100:00100000:3.0:1788918615.003721:0:12048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffae8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12048:1875816865674624:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788918615.005096:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918615.010897:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855204608 00000100:00100000:3.0:1788918615.010916:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855204608 00000100:00080000:1.0:1788918615.011016:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918615.011084:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 221 00000100:00100000:3.0:1788918615.011097:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+61:11535:x1875816855204608:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788918615.011141:0:5924:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788918615.011286:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+61:11535:x1875816855204608:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 192us (6195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918615.011295:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 221 00000100:00100000:2.0:1788918615.028807:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918615.028883:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855204736 00000100:00100000:0.0:1788918615.028894:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855204736 00000100:00100000:0.0:1788918615.028953:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 222 00000100:00100000:0.0:1788918615.028964:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+61:11535:x1875816855204736:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788918615.029084:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9bec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029101:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9bec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029116:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9bec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029180:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9bf3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029188:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029194:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029217:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9bfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029236:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029244:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918615.029309:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788918615.029314:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788918615.029330:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029342:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9bec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029349:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9bec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029356:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9bec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029362:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918615.029367:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9bec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029375:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9bec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029387:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94fffbdf3600) 00010000:00010000:0.0:1788918615.029390:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918615.029407:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9bec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029414:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9bec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029456:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029474:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9bf3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029479:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029484:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918615.029487:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029690:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029702:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff94fff6819200) 00010000:00010000:0.0:1788918615.029705:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918615.029709:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9bf3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029715:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9bf3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029731:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029736:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9bfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029741:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9bfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029746:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918615.029756:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9bfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.029762:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9bfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.030110:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:0.0:1788918615.030114:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918615.030117:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9bfa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.030124:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9bfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918615.030337:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+61:11535:x1875816855204736:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 Request processed in 1370us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918615.030346:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 222 00000100:00100000:0.0:1788918615.059649:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918615.060729:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855204992 00000100:00100000:2.0:1788918615.060742:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855204992 00000100:00100000:2.0:1788918615.060948:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 223 00000100:00100000:2.0:1788918615.060962:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+61:11535:x1875816855204992:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788918615.060986:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918615.061012:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9c01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f072e expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.061133:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.061150:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.061162:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918615.061172:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788918615.061249:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.061268:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.061274:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.061279:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48ddc00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918615.061283:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.061289:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.062283:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:2.0:1788918615.062288:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788918615.062465:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.062474:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.062765:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9c01 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f072e expref: 63 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.062847:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94fffbdf3600) 00010000:00010000:2.0:1788918615.062849:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788918615.062854:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9c01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f072e expref: 63 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.062865:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd800, rc 0) 00000100:00100000:2.0:1788918615.062998:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+62:11535:x1875816855204992:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 2039us (3357us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788918615.063006:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 223 00000100:00100000:1.0:1788918615.069526:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918615.070002:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855205120 00000100:00100000:3.0:1788918615.070045:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855205120 00000100:00100000:3.0:1788918615.070107:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 224 00000100:00100000:3.0:1788918615.070117:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+62:11535:x1875816855205120:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788918615.070152:0:11359:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788918615.070265:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+62:11535:x1875816855205120:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 150us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918615.070273:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 224 00000100:00100000:0.0:1788918615.081224:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918615.081408:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855205376 00000100:00100000:3.0:1788918615.081426:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855205376 00000100:00100000:3.0:1788918615.081487:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 225 00000100:00100000:3.0:1788918615.081497:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+62:11535:x1875816855205376:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788918615.081517:0:5924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918615.081520:0:5924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788918615.081726:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9ba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0712 expref: 62 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.081749:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918615.081756:0:5924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918615.081843:0:5924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9c16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0735 expref: -99 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788918615.091751:0:5924:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788918615.092009:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.092055:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.092068:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.092136:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9c16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0735 expref: 64 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.092158:0:5924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0735 expref: 63 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.092167:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94ffff5d1d00) 00010000:00010000:2.0:1788918615.092170:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918615.092174:0:5924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48ddc00, rc 0) 00000100:00100000:2.0:1788918615.092688:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+63:11535:x1875816855205376:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 11189us (11472us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788918615.092698:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 225 00000100:00100000:2.0:1788918615.098149:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918615.098263:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855205632 00000100:00100000:3.0:1788918615.098273:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855205632 00000100:00100000:3.0:1788918615.099657:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 226 00000100:00100000:3.0:1788918615.099673:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+63:11535:x1875816855205632:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788918615.099734:0:11359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918615.100667:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48ddc00/0x2811b8b2b0ac9c1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0735 expref: 63 pid: 5924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.100694:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94ffff5d1d00) 00010000:00010000:3.0:1788918615.100708:0:11359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918615.100738:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9c2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.100755:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9c2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.100868:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9c2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.100942:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9c32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbbe9af0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.100951:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbe9af0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.100958:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbe9af0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101006:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9c2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101014:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9c2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101065:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9c2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101071:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918615.101086:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9c2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101094:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9c2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101104:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:3.0:1788918615.101107:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918615.101110:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9c2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101117:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030a00/0x2811b8b2b0ac9c2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101128:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbe9af0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101134:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9c32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbe9af0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101139:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9c32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbe9af0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101144:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918615.101147:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9c32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbe9af0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101153:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9c32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbe9af0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101159:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbbe9af0f (ffff94fffca17100) 00010000:00010000:3.0:1788918615.101161:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918615.101170:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9c32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbbe9af0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.101176:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9c32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbbe9af0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918615.101277:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+62:11535:x1875816855205632:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 1608us (3137us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788918615.101285:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 226 00000100:00100000:1.0:1788918615.105113:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918615.105265:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855205760 00000100:00100000:2.0:1788918615.105276:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855205760 00000100:00100000:2.0:1788918615.105337:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 227 00000100:00100000:2.0:1788918615.105361:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+62:11535:x1875816855205760:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788918615.105383:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918615.105428:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9c39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f073c expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.105466:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.105480:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.105492:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.105609:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0ac9c39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f073c expref: 64 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.105627:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f073c expref: 63 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.105637:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:2.0:1788918615.105640:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788918615.105643:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd000, rc 0) 00000100:00100000:2.0:1788918615.105702:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+63:11535:x1875816855205760:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 343us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918615.105710:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 227 00000100:00100000:2.0:1788918615.119355:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918615.120065:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855206016 00000100:00100000:0.0:1788918615.120076:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855206016 00000100:00100000:0.0:1788918615.120196:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 228 00000100:00100000:0.0:1788918615.120208:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+63:11535:x1875816855206016:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788918615.120300:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9c47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.120318:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.120332:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788918615.121270:0:5925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1788918615.121283:0:5925:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 317402261804ns, next at 318402258744ns, rc = 0 00000004:00010000:1.0:1788918615.121337:0:5925:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bfcf620 reply state 00000000418c341d transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918615.121348:0:5925:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788918615.121550:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+65:11535:x1875816855206016:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 1341us (2202us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788918615.121559:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 228 00000100:00100000:3.0:1788918615.127464:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:2.0:1788918615.128800:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.128831:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9c47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.128839:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9c47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.128846:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918615.128851:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9c47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.128860:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9c47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.128880:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:2.0:1788918615.128883:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788918615.128889:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9c47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.128895:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9c47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918615.129046:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855206144 00000100:00100000:1.0:1788918615.129056:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855206144 00000100:00100000:1.0:1788918615.129107:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 229 00000100:00100000:1.0:1788918615.129117:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+64:11535:x1875816855206144:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788918615.129141:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918615.129160:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9c4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0743 expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.129232:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9c4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0743 expref: 65 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.129245:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9c4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0743 expref: 65 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.129263:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:1.0:1788918615.129266:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788918615.129268:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5400, rc 0) 00000100:00100000:1.0:1788918615.129339:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+65:11535:x1875816855206144:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 222us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918615.129346:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 229 00000100:00100000:0.0:1788918615.133580:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918615.134047:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855206272 00000100:00100000:3.0:1788918615.134059:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855206272 00000100:00100000:2.0:1788918615.134190:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00100000:2.0:1788918615.134199:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+9:2350:x1875816855206272:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788918615.134409:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+10:2350:x1875816855206272:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 211us (839us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788918615.134426:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00080000:0.0:1788918615.134528:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788918615.145592:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918615.145755:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855206528 00000100:00100000:1.0:1788918615.145775:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855206528 00000100:00100000:1.0:1788918615.145841:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:1.0:1788918615.145851:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+65:11535:x1875816855206528:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788918615.146095:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+66:11535:x1875816855206528:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 245us (513us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788918615.146103:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:3.0:1788918615.148485:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918615.148599:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855206784 00000100:00100000:2.0:1788918615.148609:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855206784 00000100:00100000:2.0:1788918615.148665:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 230 00000100:00100000:2.0:1788918615.148700:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+66:11535:x1875816855206784:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788918615.148813:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+66:11535:x1875816855206784:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 115us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918615.148821:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 230 00000100:00100000:3.0:1788918615.156617:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918615.156842:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855206912 00000100:00100000:1.0:1788918615.156853:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855206912 00000100:00100000:1.0:1788918615.156932:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 231 00000100:00100000:1.0:1788918615.156943:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+66:11535:x1875816855206912:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788918615.156963:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918615.156998:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f074a expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.157107:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9c5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.157123:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.157135:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918615.157180:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788918615.157200:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.157229:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f074a expref: 68 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.157249:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9c5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f074a expref: 67 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.157258:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:1.0:1788918615.157261:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788918615.157265:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4000, rc 0) 00000100:00100000:1.0:1788918615.157334:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+67:11535:x1875816855206912:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 392us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918615.157342:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 231 00000100:00100000:0.0:1788918615.160016:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918615.160175:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855207040 00000100:00100000:3.0:1788918615.160186:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855207040 00000100:00100000:3.0:1788918615.160239:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:3.0:1788918615.160249:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+10:2350:x1875816855207040:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788918615.160372:0:7258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918615.160403:0:7258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e270d2/0x2811b8b2b0ac9c63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0751 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788918615.160440:0:7258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0bb55, blocks: 0x0 00010000:00010000:3.0:1788918615.160462:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=317s v=(0 0) 00010000:00010000:3.0:1788918615.160467:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918615.160476:0:7258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e270d2/0x2811b8b2b0ac9c63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0751 expref: 11 pid: 7258 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.160496:0:7258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078e270d2/0x2811b8b2b0ac9c63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0751 expref: 11 pid: 7258 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.160527:0:7258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0031400, rc 0) 00000100:00100000:3.0:1788918615.160760:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+11:2350:x1875816855207040:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 511us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918615.160839:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:3.0:1788918615.174269:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918615.174886:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855207296 00000100:00100000:2.0:1788918615.174897:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855207296 00000100:00100000:2.0:1788918615.174960:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 232 00000100:00100000:2.0:1788918615.174970:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+67:11535:x1875816855207296:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788918615.175120:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+67:11535:x1875816855207296:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 150us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918615.175128:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 232 00000100:00100000:0.0:1788918615.178844:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918615.179051:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855207424 00000100:00100000:3.0:1788918615.179060:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855207424 00000100:00100000:3.0:1788918615.179115:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:3.0:1788918615.179124:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+11:11535:x1875816855207424:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788918615.179142:0:6911:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918615.179159:0:6911:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0ac9c6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0758 expref: -99 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.179189:0:6911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078e270d2/0x2811b8b2b0ac9c63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0751 expref: 12 pid: 7258 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.179197:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918615.179202:0:6911:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918615.179207:0:6911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0ac9c6a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0758 expref: 12 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.179241:0:6911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078e270d2/0x2811b8b2b0ac9c63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0751 expref: 12 pid: 7258 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.179281:0:6911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078e270d2/0x2811b8b2b0ac9c63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0751 expref: 12 pid: 7258 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918615.179296:0:6911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6911:1875816865674752:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918615.179921:0:6911:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd3298900 going to sleep for 11 seconds 00000100:00100000:3.0:1788918615.184826:0:6911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6911:1875816865674752:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918615.184867:0:6911:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0ac9c6a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0758 expref: 12 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.184889:0:6911:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0030a00, rc 0) 00000100:00100000:3.0:1788918615.184961:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+12:11535:x1875816855207424:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 5837us (6133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918615.184971:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:0.0:1788918615.185933:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918615.186986:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855207552 00000100:00100000:2.0:1788918615.186998:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855207552 00010000:00010000:2.0:1788918615.187078:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078e270d2/0x2811b8b2b0ac9c63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0751 expref: 12 pid: 7258 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918615.187124:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 86 00000100:00100000:2.0:1788918615.187134:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+12:2349:x1875816855207552:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918615.187149:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918615.187168:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078e270d2/0x2811b8b2b0ac9c63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0751 expref: 12 pid: 7258 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.187182:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078e270d2/0x2811b8b2b0ac9c63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0751 expref: 12 pid: 7258 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.187225:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e270d2/0x2811b8b2b0ac9c63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0751 expref: 12 pid: 7258 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.187243:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918615.187248:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918615.187256:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0ac9c6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0758 expref: 11 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.187266:0:5909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0ac9c6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0758 expref: 11 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.187303:0:5909:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0ac9c6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0758 expref: 11 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918615.187317:0:5909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5909:1875816865674880:192.168.202.49@tcp:105: 00000100:00100000:2.0:1788918615.189553:0:5909:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc71e6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788918615.192269:0:5909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5909:1875816865674880:192.168.202.49@tcp:105: 00010000:00010000:1.0:1788918615.192300:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918615.192381:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+11:2349:x1875816855207552:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 5247us (6451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918615.192394:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 86 00000100:00100000:0.0:1788918615.199644:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918615.200325:0:6917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855207680 00000100:00100000:3.0:1788918615.200341:0:6917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855207680 00002000:00100000:3.0:1788918615.200411:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff94ffffb2ea00 x1875816855207680/t0(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:486/0 lens 504/0 e 0 to 0 dl 1788918626 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788918615.200431:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffffb2ea00 with x1875816855207680 ext(0->12) 00002000:00010000:3.0:1788918615.200437:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffffb2ea00 00000100:00100000:3.0:1788918615.200474:0:6917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:3.0:1788918615.200485:0:6917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b921db9-4859-438b-976e-b950f67eace4+11:2349:x1875816855207680:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788918615.205951:0:6917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9b921db9-4859-438b-976e-b950f67eace4+13:2349:x1875816855207680:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 Request processed in 5453us (6309us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788918615.205980:0:6917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00002000:00100000:3.0:1788918615.205995:0:6917:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff94ffffb2ea00 x1875816855207680/t4294967320(0) o4->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:486/0 lens 504/448 e 0 to 0 dl 1788918626 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788918615.206007:0:6917:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffffb2ea00 with x1875816855207680 ext(0->12) 00002000:00010000:3.0:1788918615.206014:0:6917:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffffb2ea00 00000100:00100000:3.0:1788918615.208195:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918615.209213:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855207808 00000100:00100000:0.0:1788918615.209226:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855207808 00000100:00100000:0.0:1788918615.209295:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 233 00000100:00100000:0.0:1788918615.209306:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+67:11535:x1875816855207808:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788918615.219186:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788918615.219203:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:3.0:1788918615.219695:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788918615.219724:0:5903:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94ffd820b3c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788918615.219729:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94fff48b4900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94ffd820be40 00000020:00080000:3.0:1788918615.219732:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94fff48b4d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94ffefd60c00 00000004:00080000:3.0:1788918615.219757:0:5903:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:2.0:1788918615.219797:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788918615.219925:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788918615.219944:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865675008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788918615.220035:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918615.220104:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865675008 00000100:00100000:0.0:1788918615.220112:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865675008 00000100:00100000:0.0:1788918615.220160:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788918615.220170:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff4ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3420:x1875816865675008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788918615.220203:0:6909:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1788918615.220236:0:6909:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa0bb54, atime: 0x6aa0bb54, ctime: 0x6aa0bb54, blocks: 0x8 00010000:00010000:0.0:1788918615.220244:0:6909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9c71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.220261:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=317s v=(0 0) 00010000:00010000:0.0:1788918615.220265:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918615.220272:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9c71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.220302:0:6909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9c71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.220312:0:6909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9c71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.220321:0:6909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9c71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.220339:0:6909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788918615.220514:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff4ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3420:x1875816865675008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 344us (477us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788918615.220521:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1788918615.220681:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918615.220688:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9c71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.220696:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918615.220700:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9c71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.220710:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9c71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.220726:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9c71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.220741:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9c71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.220760:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918615.220762:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918615.220764:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788918615.220795:0:3420:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94ffffb2d880/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788918615.220802:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865675008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788918615.221649:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788918615.221663:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865675136:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788918615.221706:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918615.221746:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865675136 00000100:00100000:2.0:1788918615.221751:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865675136 00000100:00100000:2.0:1788918615.221808:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788918615.221816:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3419:x1875816865675136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788918615.221835:0:6912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1788918615.221866:0:6912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.221884:0:6912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0ac9a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f06b0 expref: 12 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.221893:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788918615.221896:0:6912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788918615.221901:0:6912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.221928:0:6912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0ac9a25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06b0 expref: 12 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.221942:0:6912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0ac9a25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06b0 expref: 12 pid: 6912 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918615.221953:0:6912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1875816865675392:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788918615.222006:0:6912:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc71e6840 going to sleep for 11 seconds 00000100:00080000:2.0:1788918615.222045:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788918615.222280:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865675264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788918615.222306:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918615.222688:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865675264 00000100:00100000:2.0:1788918615.222693:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865675264 00000100:00100000:2.0:1788918615.222715:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788918615.222722:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3417:x1875816865675264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788918615.222829:0:6909:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788918615.222833:0:6909:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788918614 00002000:00010000:2.0:1788918615.222835:0:6909:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788918615.222845:0:6909:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788918613 -> 1788918614 00002000:00010000:2.0:1788918615.222847:0:6909:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788918615.222894:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3417:x1875816865675264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (586us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788918615.222901:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:0.0:1788918615.223051:0:3417:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94ffff847480/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788918615.223058:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865675264:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1788918615.224401:0:5903:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94ffc71e6480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788918615.224411:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94fffc8ba500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94ffc71e6900 00000020:00080000:3.0:1788918615.224414:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94fffc8baf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94ffff89bc00 00000020:00080000:3.0:1788918615.224436:0:5903:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1788918615.224837:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+21:11535:x1875816855207808:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 Request processed in 15521us (16642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918615.224847:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 233 00000020:00080000:2.0:1788918615.225513:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788918615.225728:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788918615.230079:0:6912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6912:1875816865675392:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918615.230115:0:6912:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918615.232257:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918615.232396:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855207936 00000100:00100000:3.0:1788918615.232408:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855207936 00010000:00010000:3.0:1788918615.232481:0:7989:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0ac9a25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06b0 expref: 13 pid: 6912 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918615.232542:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 87 00000100:00100000:3.0:1788918615.232560:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5096050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+13:2350:x1875816855207936:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788918615.232594:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918615.232601:0:7989:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0ac9a25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06b0 expref: 13 pid: 6912 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.232616:0:7989:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0ac9a25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06b0 expref: 13 pid: 6912 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.232639:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0ac9a25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.49@tcp remote: 0x797745954e8f06b0 expref: 13 pid: 6912 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.232659:0:7989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788918615.232664:0:7989:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788918615.232670:0:7989:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.232680:0:7989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.232721:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918615.232981:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5096050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b921db9-4859-438b-976e-b950f67eace4+12:2350:x1875816855207936:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 429us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918615.232990:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 87 00010000:00010000:2.0:1788918615.233151:0:6912:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.233162:0:6912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.233172:0:6912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.233181:0:6912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.233205:0:6912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788918615.233399:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3419:x1875816865675136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11581us (11690us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788918615.233409:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:2.0:1788918615.233485:0:3419:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94ffff847b80/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788918615.233493:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865675136:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788918615.234489:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918615.234509:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.234551:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dde00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918615.234562:0:5912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.234574:0:5912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.234593:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.234601:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044143b88/0x2811b8b2b0ac9c78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.234623:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918615.234625:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918615.234627:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918615.238675:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918615.238926:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855208064 00000100:00100000:2.0:1788918615.238937:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855208064 00000100:00100000:2.0:1788918615.239000:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:2.0:1788918615.239010:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+12:2350:x1875816855208064:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788918615.245135:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1788918615.245152:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1788918615.245645:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+7:2350:x1875816855208064:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 Request processed in 6629us (6975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918615.245657:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:0.0:1788918615.269016:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918615.269523:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855208320 00000100:00100000:2.0:1788918615.269534:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855208320 00000100:00100000:2.0:1788918615.269609:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 234 00000100:00100000:2.0:1788918615.269619:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+21:11535:x1875816855208320:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788918615.269687:0:11359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918615.269717:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0ac9c5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f074a expref: 21 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.269739:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:2.0:1788918615.269744:0:11359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788918615.269789:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9c7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.269804:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.269815:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788918615.269950:0:11359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a58a19e reply state 0000000028a2beec transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918615.269959:0:11359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788918615.270103:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+22:11535:x1875816855208320:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 485us (1096us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788918615.270111:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 234 00010000:00010000:2.0:1788918615.275684:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.275709:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9c7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.275718:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.275724:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dce00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918615.275731:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.275740:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9c7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.275758:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:2.0:1788918615.275761:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918615.275778:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9c7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.275786:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0ac9c7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918615.283938:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918615.287060:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855208448 00000100:00100000:3.0:1788918615.287077:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855208448 00000100:00100000:3.0:1788918615.287143:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 71 00000100:00100000:3.0:1788918615.287154:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855208448:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788918615.287341:0:6911:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788918615.287345:0:6911:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788918614 -> 1788918613 00002000:00010000:3.0:1788918615.287347:0:6911:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788918612 00002000:00010000:3.0:1788918615.287349:0:6911:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788918614 -> 1788918613 00002000:00010000:3.0:1788918615.287364:0:6911:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788918615.289281:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+8:2349:x1875816855208448:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 2115us (5345us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788918615.289298:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 71 00000100:00100000:3.0:1788918615.295005:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918615.295341:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855208704 00000100:00100000:1.0:1788918615.295357:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855208704 00000100:00100000:1.0:1788918615.295459:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 235 00000100:00100000:1.0:1788918615.295473:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+21:11535:x1875816855208704:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788918615.295596:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.295618:0:5926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f073c expref: 21 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.295896:0:5926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.295937:0:5926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f073c expref: 21 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.295953:0:5926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f073c expref: 21 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918615.295973:0:5926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff846680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865675520:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918615.296804:0:5926:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc531d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788918615.310169:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918615.310282:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855208832 00000100:00100000:2.0:1788918615.310300:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855208832 00010000:00010000:2.0:1788918615.310346:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c40 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f073c expref: 22 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918615.310408:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 88 00000100:00100000:2.0:1788918615.310427:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+22:2350:x1875816855208832:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918615.310443:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918615.310452:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c40 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f073c expref: 22 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.310468:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f073c expref: 22 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.310494:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:2.0:1788918615.310499:0:5910:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.310513:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.310522:0:5910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.310899:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918615.310965:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+22:2350:x1875816855208832:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 546us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918615.310973:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 88 00010000:00010000:1.0:1788918615.311592:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f073c expref: 21 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918615.311633:0:5926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff846680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5926:1875816865675520:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918615.311657:0:5926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.311667:0:5926:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.311673:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.311718:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.311726:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.311733:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.311738:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918615.311742:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.311749:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.311761:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:1.0:1788918615.311763:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788918615.312006:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.312069:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4400/0x2811b8b2b0ac9c86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918615.312138:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+20:11535:x1875816855208704:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 Request processed in 16668us (17149us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788918615.312147:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 235 00000100:00100000:3.0:1788918615.319979:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918615.320063:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855208960 00000100:00100000:0.0:1788918615.320073:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855208960 00000100:00100000:0.0:1788918615.320136:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 72 00000100:00100000:0.0:1788918615.320147:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+8:2349:x1875816855208960:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788918615.320198:0:7258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.320237:0:7258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0ac9c6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0758 expref: 8 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.320246:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918615.320251:0:7258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788918615.320256:0:7258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.320307:0:7258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0ac9c6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0758 expref: 8 pid: 6911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.320321:0:7258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0ac9c6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0758 expref: 8 pid: 6911 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918615.320338:0:7258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffb2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7258:1875816865675648:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918615.320470:0:7258:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788918615.326659:0:7258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffb2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7258:1875816865675648:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918615.326691:0:7258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918615.327436:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918615.327497:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855209088 00000100:00100000:1.0:1788918615.327506:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855209088 00010000:00010000:1.0:1788918615.328511:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0ac9c6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0758 expref: 9 pid: 6911 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918615.328577:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00100000:1.0:1788918615.328594:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+9:2349:x1875816855209088:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918615.328617:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918615.329075:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0ac9c6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0758 expref: 9 pid: 6911 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.329092:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0ac9c6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0758 expref: 9 pid: 6911 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.329114:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0ac9c6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0758 expref: 9 pid: 6911 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.329133:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788918615.329137:0:5909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788918615.329144:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.329170:0:5909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.329197:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918615.329266:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+8:2349:x1875816855209088:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 679us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918615.329274:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 89 00010000:00010000:0.0:1788918615.331813:0:7258:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.331833:0:7258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.331886:0:7258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.331895:0:7258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.331903:0:7258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.331909:0:7258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21e00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918615.331914:0:7258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.331923:0:7258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.331943:0:7258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.331951:0:7258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9c8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918615.332146:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2349:x1875816855208960:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 Request processed in 11995us (12173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918615.332157:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 72 00000100:00100000:0.0:1788918615.341439:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918615.342096:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855209344 00000100:00100000:2.0:1788918615.342117:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855209344 00000100:00100000:2.0:1788918615.342181:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 236 00000100:00100000:2.0:1788918615.342190:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+20:11535:x1875816855209344:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788918615.342312:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.342333:0:11359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9b83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0704 expref: 20 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.342343:0:11359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.342381:0:11359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0704 expref: 20 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.342397:0:11359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9b83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0704 expref: 20 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918615.342412:0:11359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865675776:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788918615.342582:0:11359:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc71e69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918615.351604:0:11359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865675776:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918615.351636:0:11359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918615.351956:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918615.352721:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855209472 00000100:00100000:1.0:1788918615.352730:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855209472 00010000:00010000:1.0:1788918615.352771:0:5911:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9b83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0704 expref: 21 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918615.352817:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 90 00000100:00100000:1.0:1788918615.352836:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+21:2349:x1875816855209472:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918615.352852:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918615.352859:0:5911:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9b83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0704 expref: 21 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.352871:0:5911:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0704 expref: 21 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.352892:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9b83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0704 expref: 21 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.352910:0:5911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:1.0:1788918615.352932:0:5911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9be5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0727 expref: 20 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.352942:0:5911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.352950:0:5911:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.352958:0:5911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.352993:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788918615.353261:0:11359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.353271:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.353467:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.353481:0:11359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9c4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0743 expref: 21 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.353489:0:11359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.353518:0:11359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9c4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0743 expref: 21 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918615.353532:0:11359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9c4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0743 expref: 21 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918615.353545:0:11359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865675904:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788918615.353814:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b921db9-4859-438b-976e-b950f67eace4+21:2349:x1875816855209472:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 978us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918615.353833:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 90 00000100:00100000:2.0:1788918615.354430:0:11359:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc71e6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788918615.369552:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918615.369635:0:5910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855209600 00000100:00100000:1.0:1788918615.369645:0:5910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855209600 00010000:00010000:1.0:1788918615.369685:0:5910:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9c4e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0743 expref: 21 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918615.369729:0:5910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 91 00000100:00100000:1.0:1788918615.369738:0:5910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+21:2350:x1875816855209600:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918615.369753:0:5910:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918615.369759:0:5910:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9c4e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0743 expref: 21 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.369773:0:5910:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9c4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0743 expref: 21 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.369816:0:5910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:1.0:1788918615.369821:0:5910:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.369842:0:5910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.369850:0:5910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.369871:0:5910:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918615.369922:0:5910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b921db9-4859-438b-976e-b950f67eace4+21:2350:x1875816855209600:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 185us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918615.369929:0:5910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 91 00010000:00010000:3.0:1788918615.373995:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5400/0x2811b8b2b0ac9c4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0743 expref: 20 pid: 5926 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918615.374053:0:11359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865675904:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918615.374076:0:11359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.374622:0:11359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.374632:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788918615.374752:0:11359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788918615.374894:0:11359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788918615.374930:0:11359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788918615.375017:0:11359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff846680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11359:1875816865676032:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788918615.375701:0:11359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918615.375762:0:11359:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b35480 going to sleep for 11 seconds 00000100:00100000:2.0:1788918615.377552:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865676032 00000100:00100000:2.0:1788918615.377568:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865676032 00000100:00100000:2.0:1788918615.377639:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788918615.377649:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11359:x1875816865676032:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788918615.377777:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11359:x1875816865676032:12345-0@lo:1000:mdt00_003.0 Request processed in 130us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918615.377785:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788918615.378788:0:11359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1788918615.378796:0:11359:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:1.0:1788918615.378816:0:11359:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94ffff847480, transno 4294967321 00000004:00080000:1.0:1788918615.378849:0:11359:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94ffff847b80, transno 4294967322 00000100:00100000:1.0:1788918615.378858:0:11359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff846680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11359:1875816865676032:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788918615.379055:0:11359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788918615.379161:0:11359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff846680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11359:1875816865676160:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788918615.379229:0:11359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918615.379514:0:11359:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc531d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918615.380067:0:5930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865676160 00000100:00100000:2.0:1788918615.380076:0:5930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865676160 00000100:00100000:2.0:1788918615.380385:0:5930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788918615.380396:0:5930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11359:x1875816865676160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788918615.380633:0:5930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11359:x1875816865676160:12345-0@lo:1000:mdt00_003.0 Request processed in 238us (1403us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788918615.380641:0:5930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788918615.387448:0:11359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff846680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11359:1875816865676160:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788918615.387550:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387562:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387570:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387576:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918615.387581:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387589:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387606:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94ffff5d1500) 00010000:00010000:0.0:1788918615.387609:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788918615.387614:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387621:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9c9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387657:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9bde lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387664:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9bde lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387694:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9bde lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387699:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918615.387702:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9bde lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387709:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9bde lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387717:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:0.0:1788918615.387720:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788918615.387727:0:11359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9be5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0727 expref: 23 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387738:0:11359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9be5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0727 expref: 23 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387746:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9be5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0727 expref: 23 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.387782:0:11359:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9be5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0727 expref: 23 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918615.387795:0:11359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffb2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865676288:192.168.202.49@tcp:105: 00000100:00100000:0.0:1788918615.387877:0:11359:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788918615.394624:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918615.394843:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855209728 00000100:00100000:1.0:1788918615.394852:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855209728 00000100:00100000:1.0:1788918615.394921:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:1.0:1788918615.394933:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+24:11534:x1875816855209728:12345-192.168.202.49@tcp:49:lfs.0 00000100:00100000:1.0:1788918615.395122:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+24:11534:x1875816855209728:12345-192.168.202.49@tcp:49:lfs.0 Request processed in 190us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918615.395131:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:2.0:1788918615.398475:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918615.398619:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855209984 00000100:00100000:3.0:1788918615.398630:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855209984 00000100:00100000:3.0:1788918615.398689:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 237 00000100:00100000:3.0:1788918615.398699:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+24:11534:x1875816855209984:12345-192.168.202.49@tcp:58:lfs.0 00000040:00080000:3.0:1788918615.398889:0:5924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788918615.398970:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+24:11534:x1875816855209984:12345-192.168.202.49@tcp:58:lfs.0 Request processed in 272us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918615.398978:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 237 00000100:00100000:0.0:1788918615.401035:0:11359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffb2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11359:1875816865676288:192.168.202.49@tcp:105: 00010000:00010000:0.0:1788918615.401090:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9bde lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.401101:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0030000/0x2811b8b2b0ac9bde lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401564:0:11359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401582:0:11359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401594:0:11359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401605:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401613:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401620:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401633:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918615.401639:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401647:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401661:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:1.0:1788918615.401664:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918615.401668:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401675:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401687:0:11359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401694:0:11359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401700:0:11359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401706:0:11359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dcc00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918615.401709:0:11359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401715:0:11359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401734:0:11359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:1.0:1788918615.401737:0:11359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788918615.401740:0:11359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.401746:0:11359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dcc00/0x2811b8b2b0ac9c94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11359 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788918615.402146:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788918615.402152:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788918615.402172:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788918615.402181:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788918615.402580:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+23:11535:x1875816855209344:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 60385us (61143us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788918615.402591:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 236 00000020:00080000:1.0:1788918615.402597:0:11359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788918615.403440:0:12048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefddea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12048:1875816865676416:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788918615.403530:0:12048:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc894f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788918615.423118:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918615.423148:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918615.423262:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855210368 00000100:00100000:0.0:1788918615.423272:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855210368 00000100:00100000:0.0:1788918615.423328:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 238 00000100:00100000:0.0:1788918615.423339:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+24:11537:x1875816855210368:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788918615.423376:0:5925:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788918615.423494:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+24:11537:x1875816855210368:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 157us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918615.423503:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 238 00000100:00100000:3.0:1788918615.424124:0:12048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefddea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12048:1875816865676416:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788918615.424404:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855210240 00000100:00100000:1.0:1788918615.424411:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855210240 00000100:00100000:1.0:1788918615.424461:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00100000:1.0:1788918615.424470:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5145450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+23:11535:x1875816855210240:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788918615.424698:0:5928:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788918615.424729:0:5928:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1788918615.424766:0:5928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.424783:0:5928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.424796:0:5928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.424806:0:5928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.424833:0:5928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.424841:0:5928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.424856:0:5928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788918615.424934:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5145450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+25:11535:x1875816855210240:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 466us (1836us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788918615.424943:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 62 00000020:00080000:1.0:1788918615.424948:0:5928:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788918615.425231:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918615.425239:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.425258:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4e00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918615.425263:0:5913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.425272:0:5913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.425297:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff94fff699ee00) 00010000:00010000:0.0:1788918615.425301:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788918615.425306:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.425324:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0ac9ca9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.425343:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918615.425344:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918615.425346:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918615.438679:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918615.440966:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855210624 00000100:00100000:1.0:1788918615.440981:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855210624 00000100:00100000:1.0:1788918615.441092:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 239 00000100:00100000:1.0:1788918615.441102:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+25:11537:x1875816855210624:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788918615.441127:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918615.441147:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5a00/0x2811b8b2b0ac9cb0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f075f expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.441276:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9cb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.441296:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.441308:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918615.441320:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788918615.441467:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5a00/0x2811b8b2b0ac9cb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f075f expref: 28 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.441498:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f075f expref: 27 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918615.441509:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:1.0:1788918615.441513:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788918615.441517:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4600, rc 0) 00000100:00100000:1.0:1788918615.441819:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+27:11537:x1875816855210624:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 718us (3163us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788918615.441895:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 239 00000100:00100000:3.0:1788918615.450193:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918615.450239:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918615.450286:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855210752 00000100:00100000:0.0:1788918615.450296:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855210752 00000100:00100000:0.0:1788918615.450352:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855211008 00000100:00100000:0.0:1788918615.450355:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855211008 00000100:00100000:0.0:1788918615.450388:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 240 00000100:00100000:0.0:1788918615.450398:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+28:11538:x1875816855210752:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918615.450437:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788918615.450455:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 241 00010000:00010000:0.0:1788918615.450464:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9cc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0766 expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918615.450465:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefdde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+28:11537:x1875816855211008:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788918615.450521:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9ccc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.450524:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.450539:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.450539:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9ccc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.450553:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.450553:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9ccc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.450568:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9cda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.450573:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.450596:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.450666:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9ce1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.450676:0:5925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0720 expref: 29 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.450685:0:5925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9ce1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.450716:0:5925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0720 expref: 29 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.450729:0:5925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0720 expref: 29 pid: 11359 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918615.450744:0:5925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffb2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865676544:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918615.450823:0:5926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.450832:0:5926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.450838:0:5926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918615.450843:0:5925:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fbc00 going to sleep for 11 seconds 00010000:00010000:3.0:1788918615.450844:0:5926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918615.450848:0:5926:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.450855:0:5926:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cd3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.450876:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:3.0:1788918615.450879:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788918615.450884:0:5926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cd3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918615.450890:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918615.450995:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefdde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9b921db9-4859-438b-976e-b950f67eace4+30:11537:x1875816855211008:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 531us (755us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788918615.451003:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 241 00000040:00080000:2.0:1788918615.451131:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788918615.451137:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788918615.451654:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788918615.451663:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788918615.459984:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918615.460045:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855211264 00000100:00100000:1.0:1788918615.460054:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855211264 00000100:00100000:1.0:1788918615.460167:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:3.0:1788918615.460168:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918615.460230:0:5925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffb2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5925:1875816865676544:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918615.460267:0:5925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9ce1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918615.461347:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+30:5433:x1875816855211264:12345-192.168.202.49@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788918615.461595:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+31:5433:x1875816855211264:12345-192.168.202.49@tcp:35:ldlm_bl.0 Request processed in 1416us (1622us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788918615.461604:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:3.0:1788918615.465327:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918615.465459:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855211520 00000100:00100000:1.0:1788918615.465470:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855211520 00000100:00100000:1.0:1788918615.465512:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00100000:1.0:1788918615.465522:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+31:11537:x1875816855211520:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788918615.466726:0:5909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855211648 00000100:00100000:0.0:1788918615.466735:0:5909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855211648 00010000:00010000:0.0:1788918615.466775:0:5909:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0720 expref: 32 pid: 11359 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918615.467361:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 92 00000100:00100000:0.0:1788918615.467371:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+32:2349:x1875816855211648:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918615.467386:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918615.467393:0:5909:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0720 expref: 32 pid: 11359 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.467406:0:5909:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0720 expref: 32 pid: 11359 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.467437:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031c00/0x2811b8b2b0ac9bd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0720 expref: 32 pid: 11359 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.467457:0:5909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:0.0:1788918615.467462:0:5909:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9ce1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.467471:0:5909:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.467479:0:5909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9ce1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.467520:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918615.467577:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b921db9-4859-438b-976e-b950f67eace4+31:2349:x1875816855211648:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 208us (2563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918615.467585:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 92 00010000:00010000:0.0:1788918615.467615:0:5925:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918615.467774:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+31:11537:x1875816855211520:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 2253us (7603us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788918615.467781:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 64 00010000:00010000:0.0:1788918615.468490:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918615.468537:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788918615.468542:0:5925:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788918615.468558:0:5925:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468572:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468582:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9ccc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468589:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9ccc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468595:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9ccc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468601:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21c00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918615.468605:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9ccc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468612:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9ccc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468633:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:0.0:1788918615.468638:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918615.468642:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9ccc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468661:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21c00/0x2811b8b2b0ac9ccc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468675:0:5925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468681:0:5925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9cda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468687:0:5925:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9cda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468691:0:5925:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918615.468694:0:5925:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9cda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468700:0:5925:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9cda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468708:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94fff6819200) 00010000:00010000:0.0:1788918615.468711:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918615.468714:0:5925:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9cda lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468720:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21800/0x2811b8b2b0ac9cda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468754:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20600/0x2811b8b2b0ac9cc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0766 expref: 31 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468768:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0766 expref: 30 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918615.468784:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:0.0:1788918615.468786:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788918615.468788:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21400, rc 0) 00000100:00100000:0.0:1788918615.468819:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+30:11538:x1875816855210752:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 18423us (18637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918615.468838:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 240 00000100:00100000:0.0:1788918615.638846:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865676672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918615.638946:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918615.639035:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865677184:0@lo:400:kworker.0 00000100:00100000:0.0:1788918615.639075:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918615.639104:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788918615.639110:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865677056:0@lo:400:kworker.0 00000100:00100000:0.0:1788918615.639130:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918615.639157:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff48a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865676928:0@lo:400:kworker.0 00000100:00100000:0.0:1788918615.639194:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918615.639212:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788918615.639217:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865676800:0@lo:400:kworker.0 00000100:00100000:0.0:1788918615.639245:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918615.639799:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865677184 00000100:00100000:0.0:1788918615.639812:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865677184 00000100:00100000:0.0:1788918615.639889:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865677056 00000100:00100000:0.0:1788918615.639892:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865677056 00000100:00100000:0.0:1788918615.639904:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865676928 00000100:00100000:0.0:1788918615.639907:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865676928 00000100:00100000:0.0:1788918615.639922:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788918615.639947:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865677184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918615.640014:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865677184:12345-0@lo:400:kworker.0 Request processed in 68us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918615.640046:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788918615.640066:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788918615.640072:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865677056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918615.640100:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865677056:12345-0@lo:400:kworker.0 Request processed in 28us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918615.640106:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788918615.640117:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788918615.640123:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865676928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918615.640149:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865676928:12345-0@lo:400:kworker.0 Request processed in 26us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918615.640155:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1788918615.640332:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918615.640372:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff48a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865676928:0@lo:400:kworker.0 00000100:00100000:0.0:1788918615.640403:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865677056:0@lo:400:kworker.0 00000100:00100000:0.0:1788918615.640426:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865677184:0@lo:400:kworker.0 00000100:00100000:3.0:1788918615.640564:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865676672 00000100:00100000:3.0:1788918615.640570:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865676672 00000100:00100000:3.0:1788918615.640619:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788918615.640627:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3418:x1875816865676672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788918615.640646:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42295872 pending 0 free 3923664896 avail 3692113920 00000100:00100000:3.0:1788918615.640688:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3418:x1875816865676672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918615.640694:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788918615.640842:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865676672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918615.640946:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865676800 00000100:00100000:1.0:1788918615.640951:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865676800 00000100:00100000:1.0:1788918615.640991:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788918615.640999:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865676800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918615.641068:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865676800:12345-0@lo:400:kworker.0 Request processed in 70us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918615.641074:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788918615.641382:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865676800:0@lo:400:kworker.0 00010000:00010000:1.0:1788918615.705584:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918616.240251:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918616.240305:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918616.240345:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918616.240398:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855211904 00000100:00100000:0.0:1788918616.240425:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855211904 00000100:00100000:0.0:1788918616.240530:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:0.0:1788918616.240544:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+7:2351:x1875816855211904:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918616.240638:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+7:2351:x1875816855211904:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 97us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918616.240647:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00080000:0.0:1788918616.240676:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918616.240753:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855212032 00000100:00100000:3.0:1788918616.240759:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855212032 00000100:00100000:3.0:1788918616.240814:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 167 00000100:00100000:1.0:1788918616.240821:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855211776 00000100:00100000:3.0:1788918616.240824:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855212032:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918616.240828:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855211776 00000100:00100000:1.0:1788918616.240866:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 298 00000100:00100000:1.0:1788918616.240876:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855211776:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918616.240882:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855212032:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 59us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918616.240891:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 167 00000100:00100000:1.0:1788918616.240932:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855211776:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 57us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918616.240940:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 298 00000100:00080000:0.0:1788918616.243140:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788918616.576721:0:12908:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788918616.576733:0:12908:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788918616.576770:0:12908:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788918616.576777:0:12908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788918616.670164:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865677312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918616.670335:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918616.671643:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865677312 00000100:00100000:2.0:1788918616.671659:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865677312 00000100:00100000:2.0:1788918616.671748:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788918616.671759:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3419:x1875816865677312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918616.671806:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25563712 pending 28672 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918616.671974:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3419:x1875816865677312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 216us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918616.671982:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788918616.672080:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865677312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788918616.673490:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788918616.731187:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918616.754895:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918616.755061:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855212288 00000100:00100000:2.0:1788918616.755076:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855212288 00000100:00100000:2.0:1788918616.755155:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 242 00000100:00100000:2.0:1788918616.755177:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+30:11561:x1875816855212288:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788918616.755210:0:5925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918616.755238:0:5925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9ce8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f076d expref: -99 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918616.755418:0:5925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9cef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918616.755436:0:5925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9cef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918616.755451:0:5925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9cef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5925 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918616.755465:0:5925:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788918616.755609:0:5925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0ac9ce8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f076d expref: 33 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918616.755628:0:5925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9cef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f076d expref: 32 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918616.755638:0:5925:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:2.0:1788918616.755641:0:5925:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788918616.755646:0:5925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dc600, rc 0) 00000100:00100000:2.0:1788918616.755738:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+32:11561:x1875816855212288:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 562us (859us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788918616.755746:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 242 00000100:00100000:2.0:1788918616.761418:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918616.761557:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855212416 00000100:00100000:3.0:1788918616.761571:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855212416 00000100:00100000:3.0:1788918616.761641:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 243 00000100:00100000:3.0:1788918616.761653:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+32:11561:x1875816855212416:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:3.0:1788918616.761742:0:5924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918616.761765:0:5924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918616.761781:0:5924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918616.761834:0:5924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918616.761842:0:5924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918616.761850:0:5924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918616.761856:0:5924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918616.761871:0:5924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918616.761880:0:5924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918616.761894:0:5924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:3.0:1788918616.761897:0:5924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788918616.761903:0:5924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918616.761910:0:5924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffc0031400/0x2811b8b2b0ac9cfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918616.762008:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+32:11561:x1875816855212416:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 356us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918616.762016:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 243 00000100:00100000:0.0:1788918616.975881:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918616.976126:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855212544 00000100:00100000:2.0:1788918616.976158:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855212544 00000100:00100000:2.0:1788918616.976234:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 73 00000100:00100000:2.0:1788918616.976260:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+7:2352:x1875816855212544:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:2.0:1788918616.976287:0:6909:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918616.976314:0:6909:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5edd82d/0x2811b8b2b0ac9d04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0774 expref: -99 pid: 6909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788918616.976347:0:6909:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa0bb55, atime: 0x6aa0bb54, ctime: 0x6aa0bb55, blocks: 0x8 00010000:00010000:2.0:1788918616.976374:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1788918616.976379:0:6909:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918616.976391:0:6909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5edd82d/0x2811b8b2b0ac9d04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0774 expref: 8 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918616.976423:0:6909:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a5edd82d/0x2811b8b2b0ac9d04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0774 expref: 8 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918616.976441:0:6909:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd800, rc 0) 00000100:00100000:2.0:1788918616.976532:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+8:2352:x1875816855212544:12345-192.168.202.49@tcp:101:cat.0 Request processed in 276us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918616.976542:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 73 00000100:00100000:1.0:1788918616.992722:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918616.992834:0:6915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855212672 00000100:00100000:0.0:1788918616.992848:0:6915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855212672 00002000:00100000:0.0:1788918616.992945:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff94ffff846a00 x1875816855212672/t0(0) o3->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:487/0 lens 488/0 e 0 to 0 dl 1788918627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788918616.992959:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffff846a00 with x1875816855212672 ext(0->4095) 00002000:00010000:0.0:1788918616.992967:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffff846a00 00000100:00100000:0.0:1788918616.993011:0:6915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:0.0:1788918616.993055:0:6915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b921db9-4859-438b-976e-b950f67eace4+8:2350:x1875816855212672:12345-192.168.202.49@tcp:3:cat.0 00000100:00100000:0.0:1788918616.993481:0:6915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9b921db9-4859-438b-976e-b950f67eace4+8:2350:x1875816855212672:12345-192.168.202.49@tcp:3:cat.0 Request processed in 459us (772us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788918616.993490:0:6915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00002000:00100000:0.0:1788918616.993499:0:6915:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff94ffff846a00 x1875816855212672/t0(0) o3->9b921db9-4859-438b-976e-b950f67eace4@192.168.202.49@tcp:487/0 lens 488/4536 e 0 to 0 dl 1788918627 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788918616.993507:0:6915:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffff846a00 with x1875816855212672 ext(0->4095) 00002000:00010000:0.0:1788918616.993510:0:6915:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94ffff846a00 00010000:00010000:1.0:1788918617.750779:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918618.778004:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788918619.542425:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788918619.542567:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788918619.542604:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788918619.542616:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1788918619.737573:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788918619.737600:0:6905:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1788918619.800558:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918620.760248:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865677824:0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.760321:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918620.760711:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865677440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918620.760749:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918620.761211:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865677568:0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.761247:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918620.761274:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865678080:0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.761315:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918620.761342:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788918620.761348:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865677696:0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.761386:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918620.761405:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865678208:0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.761429:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918620.761471:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865677824 00000100:00100000:1.0:1788918620.761483:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865677824 00000100:00100000:1.0:1788918620.761550:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865678080 00000100:00100000:1.0:1788918620.761554:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865678080 00000100:00100000:1.0:1788918620.761568:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865677696 00000100:00100000:1.0:1788918620.761570:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865677696 00000100:00100000:1.0:1788918620.761600:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788918620.761610:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865677824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.761675:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865677824:12345-0@lo:400:kworker.0 Request processed in 66us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918620.761682:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788918620.761705:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788918620.761711:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865678080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.761742:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865678080:12345-0@lo:400:kworker.0 Request processed in 30us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918620.761748:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788918620.761759:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788918620.761766:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865677696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.761792:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865677696:12345-0@lo:400:kworker.0 Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918620.761809:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788918620.761830:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865677568 00000100:00100000:1.0:1788918620.761833:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865677568 00000100:00100000:1.0:1788918620.761858:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788918620.761864:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865677568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.761896:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3417:x1875816865677568:12345-0@lo:400:kworker.0 Request processed in 32us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918620.761902:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788918620.761933:0:6912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865678208 00000100:00100000:1.0:1788918620.761936:0:6912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865678208 00000100:00100000:1.0:1788918620.761963:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788918620.761970:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3417:x1875816865678208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.761999:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3417:x1875816865678208:12345-0@lo:400:kworker.0 Request processed in 30us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918620.762005:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788918620.762064:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865677696:0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.762078:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865678208:0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.762087:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865677568:0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.762095:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865678080:0@lo:400:kworker.0 00000100:00100000:1.0:1788918620.762138:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865677824:0@lo:400:kworker.0 00000100:00100000:0.0:1788918620.767420:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865677440 00000100:00100000:0.0:1788918620.767445:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865677440 00000100:00100000:0.0:1788918620.767512:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788918620.767522:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1875816865677440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788918620.767555:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42295872 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1788918620.767644:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3420:x1875816865677440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (6893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918620.767653:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788918620.768275:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788918620.768282:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918620.770331:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865677440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918620.770348:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865677952:0@lo:400:kworker.0 00000100:00100000:3.0:1788918620.770420:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918620.770493:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865677952 00000100:00100000:3.0:1788918620.770500:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865677952 00000100:00100000:3.0:1788918620.774759:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788918620.774775:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865677952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918620.774870:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865677952:12345-0@lo:400:kworker.0 Request processed in 100us (4449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918620.774884:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788918620.774908:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918620.774939:0:3420:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788918620.774944:0:3420:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1788918620.774964:0:3420:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94ffffb2d880, transno 4294967310 00000100:00100000:3.0:1788918620.774980:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865677952:0@lo:400:kworker.0 00000001:00080000:0.0:1788918620.779240:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1788918620.779253:0:7980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1788918620.779416:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1788918620.779443:0:5903:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94ffd820bc00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788918620.779447:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94ffc3547700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94ffd820b540 00000020:00080000:2.0:1788918620.779451:0:5903:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94ffc3547900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94ffefc4ac00 00000020:00080000:2.0:1788918620.779477:0:5903:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788918620.780274:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788918620.780348:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788918620.826214:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918621.368333:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918621.368449:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918621.368682:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855212928 00000100:00100000:2.0:1788918621.368694:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855212928 00000100:00100000:2.0:1788918621.368796:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 171 00000100:00100000:2.0:1788918621.368807:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+19:2351:x1875816855212928:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918621.368909:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+19:2351:x1875816855212928:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 103us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918621.368917:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 171 00000100:00080000:3.0:1788918621.369977:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918621.371001:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855212800 00000100:00100000:1.0:1788918621.371014:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855212800 00000100:00100000:1.0:1788918621.371099:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 300 00000100:00100000:1.0:1788918621.371110:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855212800:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918621.371332:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855212800:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 223us (3008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918621.371340:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 300 00000100:00100000:3.0:1788918621.379475:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918621.379534:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918621.379655:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918621.380134:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855213056 00000100:00100000:0.0:1788918621.380152:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855213056 00000100:00100000:0.0:1788918621.380245:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855213184 00000100:00100000:0.0:1788918621.380255:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855213184 00000100:00100000:0.0:1788918621.380292:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 88 00000100:00100000:0.0:1788918621.380307:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2351:x1875816855213056:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918621.380317:0:6912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00100000:1.0:1788918621.380336:0:6912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+7:2351:x1875816855213184:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918621.380409:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2351:x1875816855213056:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 105us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918621.380420:0:6912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9b921db9-4859-438b-976e-b950f67eace4+7:2351:x1875816855213184:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 87us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918621.380430:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 88 00000100:00100000:1.0:1788918621.380445:0:6912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00080000:3.0:1788918621.381312:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788918621.381319:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788918621.387709:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855213312 00000100:00100000:2.0:1788918621.387737:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855213312 00000100:00080000:3.0:1788918621.388069:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918621.388078:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 172 00000100:00100000:2.0:1788918621.388094:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855213312:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918621.388233:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2351:x1875816855213312:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 142us (8697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918621.388242:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 172 00000100:00100000:1.0:1788918621.783272:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788918621.783308:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865678336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918621.783424:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918621.784006:0:6914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865678336 00000100:00100000:0.0:1788918621.784059:0:6914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865678336 00000100:00100000:0.0:1788918621.784127:0:6914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788918621.784150:0:6914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865678336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788918621.784349:0:6914:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25535040 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918621.784485:0:6914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865678336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 338us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918621.784513:0:6914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788918621.794648:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865678336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788918621.851884:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918622.870306:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918622.930397:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918622.933624:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855213440 00000100:00100000:2.0:1788918622.933651:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855213440 00000100:00100000:2.0:1788918622.934087:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 244 00000100:00100000:2.0:1788918622.934100:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+19:11214:x1875816855213440:12345-192.168.202.49@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788918622.934595:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+19:11214:x1875816855213440:12345-192.168.202.49@tcp:60:lhsmtool_posix.0 Request processed in 497us (4215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918622.934606:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 244 00000100:00100000:2.0:1788918622.950689:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918622.954770:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855213696 00000100:00100000:0.0:1788918622.954791:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855213696 00000100:00100000:0.0:1788918622.954888:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:0.0:1788918622.954901:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+19:11214:x1875816855213696:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788918622.964264:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+20:11214:x1875816855213696:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 9343us (13566us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788918622.964286:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:0.0:1788918623.315014:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918623.315288:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855213824 00000100:00100000:2.0:1788918623.315303:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855213824 00000100:00100000:2.0:1788918623.315415:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 245 00000100:00100000:2.0:1788918623.315430:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:12012:x1875816855213824:12345-192.168.202.49@tcp:101:lsof.0 00010000:00010000:2.0:1788918623.315472:0:5926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918623.315503:0:5926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9d0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f077b expref: -99 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918623.315596:0:5926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9d12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918623.315615:0:5926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9d12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918623.315629:0:5926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9d12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918623.315692:0:5926:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788918623.315696:0:5926:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918623.315728:0:5926:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9d12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918623.315974:0:5926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dde00/0x2811b8b2b0ac9d0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f077b expref: 7 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918623.316081:0:5926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9d12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f077b expref: 6 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918623.316092:0:5926:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ffff5d1000) 00010000:00010000:2.0:1788918623.316095:0:5926:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788918623.316099:0:5926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd000, rc 0) 00000100:00100000:2.0:1788918623.316661:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:12012:x1875816855213824:12345-192.168.202.49@tcp:101:lsof.0 Request processed in 759us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918623.316672:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 245 00000100:00080000:3.0:1788918623.316964:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788918623.894308:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918624.919408:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918625.882086:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865678464:0@lo:400:kworker.0 00000100:00100000:1.0:1788918625.882097:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865678720:0@lo:400:kworker.0 00000100:00100000:0.0:1788918625.882207:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865678592:0@lo:400:kworker.0 00000100:00100000:3.0:1788918625.882234:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865678848:0@lo:400:kworker.0 00000100:00100000:2.0:1788918625.888133:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918625.888226:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865678976:0@lo:400:kworker.0 00000100:00100000:2.0:1788918625.888271:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918625.888411:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865678976 00000100:00100000:2.0:1788918625.888418:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865678976 00000100:00100000:2.0:1788918625.888480:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788918625.888490:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865678976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918625.888548:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865678976:12345-0@lo:400:kworker.0 Request processed in 59us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918625.888556:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:2.0:1788918625.888589:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918625.888624:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865678976:0@lo:400:kworker.0 00000100:00100000:1.0:1788918625.891175:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918625.891284:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865679232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918625.891357:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918625.891427:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865678464 00000100:00100000:1.0:1788918625.891439:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865678464 00000100:00100000:1.0:1788918625.891522:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788918625.891534:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865678464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918625.891606:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865678464:12345-0@lo:400:kworker.0 Request processed in 74us (3482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918625.891614:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788918625.891654:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865679232 00000100:00100000:1.0:1788918625.891657:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865679232 00000100:00100000:1.0:1788918625.891695:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788918625.891721:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffeff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865679232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918625.891754:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42295872 pending 0 free 3923660800 avail 3692138496 00000100:00100000:1.0:1788918625.891791:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffeff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865679232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918625.891796:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788918625.891815:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788918625.891853:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865678464:0@lo:400:kworker.0 00000100:00100000:1.0:1788918625.891892:0:3418:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788918625.891899:0:3418:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788918625.891924:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865679232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918625.892582:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918625.892620:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865679104:0@lo:400:kworker.0 00000100:00100000:0.0:1788918625.892651:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918625.892678:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865679104 00000100:00100000:0.0:1788918625.892683:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865679104 00000100:00100000:0.0:1788918625.892721:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788918625.892728:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865679104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918625.892767:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865679104:12345-0@lo:400:kworker.0 Request processed in 40us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918625.892774:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788918625.892808:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865679104:0@lo:400:kworker.0 00000100:00100000:2.0:1788918625.892973:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865678720 00000100:00100000:2.0:1788918625.892990:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865678720 00000100:00100000:2.0:1788918625.893064:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865678592 00000100:00100000:2.0:1788918625.893068:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865678592 00000100:00100000:2.0:1788918625.893084:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788918625.893090:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865678720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918625.893133:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865678720:12345-0@lo:400:kworker.0 Request processed in 43us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918625.893139:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788918625.893152:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788918625.893157:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff48a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865678592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918625.893187:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff48a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865678592:12345-0@lo:400:kworker.0 Request processed in 30us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918625.893193:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788918625.893309:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865678720:0@lo:400:kworker.0 00000100:00080000:0.0:1788918625.894436:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788918625.894488:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865678592:0@lo:400:kworker.0 00000100:00100000:3.0:1788918625.904615:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918625.904865:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865678848 00000100:00100000:0.0:1788918625.904896:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865678848 00000100:00100000:0.0:1788918625.904997:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788918625.905011:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865678848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918625.905283:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865678848:12345-0@lo:400:kworker.0 Request processed in 275us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918625.905292:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788918625.905419:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865678848:0@lo:400:kworker.0 00000100:00080000:1.0:1788918625.908064:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788918625.944180:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918626.498068:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918626.498135:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918626.498177:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918626.498203:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918626.498228:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918626.498272:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855214208 00000100:00100000:0.0:1788918626.498285:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855214208 00000100:00100000:0.0:1788918626.498375:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855214336 00000100:00100000:0.0:1788918626.498379:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855214336 00000100:00100000:0.0:1788918626.498404:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 92 00000100:00100000:0.0:1788918626.498416:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855214208:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918626.498517:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+5:2352:x1875816855214208:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 103us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918626.498525:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 92 00000100:00100000:0.0:1788918626.498546:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 93 00000100:00100000:0.0:1788918626.498553:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2352:x1875816855214336:12345-192.168.202.49@tcp:400:kworker.0 00000100:00080000:1.0:1788918626.498574:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788918626.498581:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9b921db9-4859-438b-976e-b950f67eace4+7:2352:x1875816855214336:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00080000:1.0:1788918626.498582:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788918626.498591:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 93 00000100:00100000:2.0:1788918626.498964:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855213952 00000100:00100000:2.0:1788918626.498971:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855213952 00000100:00100000:2.0:1788918626.499062:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 302 00000100:00100000:2.0:1788918626.499071:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855213952:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918626.499108:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+13:2352:x1875816855213952:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 39us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918626.499116:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 302 00000100:00100000:2.0:1788918626.499175:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855214464 00000100:00100000:2.0:1788918626.499180:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855214464 00000100:00100000:3.0:1788918626.499200:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855214080 00000100:00100000:3.0:1788918626.499215:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855214080 00000100:00100000:2.0:1788918626.499229:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 176 00000100:00100000:2.0:1788918626.499240:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2352:x1875816855214464:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918626.499258:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 177 00000100:00100000:3.0:1788918626.499269:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffc876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+20:2352:x1875816855214080:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918626.499279:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2352:x1875816855214464:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 40us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918626.499303:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 176 00000100:00080000:2.0:1788918626.499333:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918626.499350:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffc876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9b921db9-4859-438b-976e-b950f67eace4+20:2352:x1875816855214080:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 83us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918626.499358:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 177 00000100:00100000:3.0:1788918626.906751:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865679360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918626.906870:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918626.907108:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865679360 00000100:00100000:1.0:1788918626.907119:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865679360 00000100:00100000:1.0:1788918626.907212:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788918626.907224:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865679360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788918626.907268:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25535040 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918626.907352:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865679360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918626.907360:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788918626.907766:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865679360:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788918626.911616:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788918626.911633:0:5903:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788918626.911681:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788918626.911692:0:5956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788918626.966246:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788918627.885252:0:13106:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:50:24 (1788918624) 00010000:00010000:2.0:1788918627.994426:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918629.014246:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788918629.790307:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788918629.790318:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788918629.790418:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788918629.790424:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788918630.038276:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918631.000543:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788918631.000566:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865679616:0@lo:400:kworker.0 00000100:00100000:1.0:1788918631.000642:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918631.000714:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865679616 00000100:00100000:1.0:1788918631.000722:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865679616 00000100:00100000:1.0:1788918631.000787:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788918631.000796:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865679616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918631.000848:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865679616:12345-0@lo:400:kworker.0 Request processed in 53us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918631.000853:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788918631.000856:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788918631.000862:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865679488:0@lo:400:kworker.0 00000100:00100000:0.0:1788918631.000896:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918631.000906:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865679616:0@lo:400:kworker.0 00000100:00100000:1.0:1788918631.000925:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865679488 00000100:00100000:1.0:1788918631.000928:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865679488 00000100:00100000:0.0:1788918631.000951:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788918631.000952:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788918631.000958:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865679488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918631.000958:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865679744:0@lo:400:kworker.0 00000100:00100000:0.0:1788918631.000982:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918631.000989:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865679488:12345-0@lo:400:kworker.0 Request processed in 32us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918631.000995:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788918631.001039:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865679872:0@lo:400:kworker.0 00000100:00100000:0.0:1788918631.001062:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865680128:0@lo:400:kworker.0 00000100:00100000:1.0:1788918631.001063:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918631.001083:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918631.001085:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865679488:0@lo:400:kworker.0 00000100:00100000:1.0:1788918631.001096:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788918631.001100:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865680000:0@lo:400:kworker.0 00000100:00100000:0.0:1788918631.001105:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865679872 00000100:00100000:0.0:1788918631.001108:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865679872 00000100:00100000:1.0:1788918631.001121:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918631.001139:0:7258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865680128 00000100:00100000:0.0:1788918631.001142:0:7258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865680128 00000100:00100000:1.0:1788918631.001144:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788918631.001164:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865679872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918631.001211:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865679744 00000100:00100000:1.0:1788918631.001211:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865679872:12345-0@lo:400:kworker.0 Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918631.001215:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865679744 00000100:00100000:3.0:1788918631.001245:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865680000 00000100:00100000:3.0:1788918631.001249:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865680000 00000100:00100000:3.0:1788918631.001268:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788918631.001285:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865679744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918631.001322:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865679744:12345-0@lo:400:kworker.0 Request processed in 38us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918631.001328:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788918631.001335:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865680000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918631.001371:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3419:x1875816865680000:12345-0@lo:400:kworker.0 Request processed in 37us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918631.006197:0:7258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788918631.006223:0:7258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865680128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918631.006321:0:7258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865680128:12345-0@lo:400:kworker.0 Request processed in 112us (5237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918631.006329:0:7258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788918631.006401:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865680256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918631.006442:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918631.006514:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865680000:0@lo:400:kworker.0 00000100:00100000:0.0:1788918631.006528:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865679872:0@lo:400:kworker.0 00000100:00100000:0.0:1788918631.006562:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865680256 00000100:00100000:0.0:1788918631.006568:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865680256 00000100:00100000:0.0:1788918631.006610:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788918631.006628:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865680256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788918631.006650:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42295872 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1788918631.006683:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865680256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918631.006690:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788918631.006717:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865680256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918631.006762:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff489dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865680128:0@lo:400:kworker.0 00000100:00100000:0.0:1788918631.006773:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865679744:0@lo:400:kworker.0 00000100:00080000:0.0:1788918631.006812:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788918631.006817:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788918631.006820:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918631.008433:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788918631.008604:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788918631.008664:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00010000:00010000:3.0:1788918631.062481:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918631.600335:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918631.600385:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918631.600424:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918631.600452:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918631.600484:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918631.600519:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855214848 00000100:00100000:3.0:1788918631.600523:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855215104 00000100:00100000:0.0:1788918631.600529:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855214848 00000100:00100000:3.0:1788918631.600539:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855215104 00000100:00100000:0.0:1788918631.600598:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855214976 00000100:00100000:0.0:1788918631.600605:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855214976 00000100:00100000:3.0:1788918631.600621:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855214720 00000100:00100000:3.0:1788918631.600627:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855214720 00000100:00100000:0.0:1788918631.600647:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 96 00000100:00100000:0.0:1788918631.600660:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2351:x1875816855214848:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918631.600726:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2351:x1875816855214848:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 70us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918631.600733:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 96 00000100:00100000:0.0:1788918631.600749:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 97 00000100:00100000:0.0:1788918631.600769:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+7:2351:x1875816855214976:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918631.600794:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+7:2351:x1875816855214976:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 26us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918631.600800:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 97 00000100:00080000:0.0:1788918631.600820:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788918631.600824:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788918631.600826:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918631.600895:0:5917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855214592 00000100:00100000:1.0:1788918631.600900:0:5917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855214592 00000100:00100000:1.0:1788918631.600932:0:5917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 304 00000100:00100000:1.0:1788918631.600941:0:5917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855214592:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918631.600961:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 181 00000100:00100000:1.0:1788918631.600974:0:5917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89208175-5136-4226-96dc-dc05cbfafbe9+13:2351:x1875816855214592:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 33us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918631.600980:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2351:x1875816855215104:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918631.600990:0:5917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 304 00000100:00100000:3.0:1788918631.601104:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2351:x1875816855215104:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 130us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918631.602100:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 181 00000100:00100000:3.0:1788918631.602146:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 182 00000100:00100000:3.0:1788918631.602157:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+19:2351:x1875816855214720:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918631.602325:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9b921db9-4859-438b-976e-b950f67eace4+19:2351:x1875816855214720:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 170us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918631.602332:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 182 00000100:00100000:0.0:1788918632.022420:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865680384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788918632.022503:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918632.022648:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865680384 00000100:00100000:1.0:1788918632.022656:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865680384 00000100:00100000:1.0:1788918632.022708:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788918632.022719:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865680384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788918632.022748:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25535040 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918632.022805:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865680384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918632.022812:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788918632.022909:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865680384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788918632.086319:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918632.120801:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918632.121211:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855215360 00000100:00100000:2.0:1788918632.121227:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855215360 00000100:00100000:2.0:1788918632.121310:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:2.0:1788918632.121321:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+19:12234:x1875816855215360:12345-192.168.202.49@tcp:35:umount.0 00000100:00100000:2.0:1788918632.121606:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+20:12234:x1875816855215360:12345-192.168.202.49@tcp:35:umount.0 Request processed in 286us (819us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788918632.121614:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:1.0:1788918632.129409:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918632.129574:0:5927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855215616 00000100:00100000:2.0:1788918632.129586:0:5927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855215616 00000100:00100000:2.0:1788918632.129646:0:5927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 67 00000100:00100000:2.0:1788918632.129656:0:5927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+20:12234:x1875816855215616:12345-192.168.202.49@tcp:35:umount.0 00000100:00100000:2.0:1788918632.131572:0:5927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9b921db9-4859-438b-976e-b950f67eace4+21:12234:x1875816855215616:12345-192.168.202.49@tcp:35:umount.0 Request processed in 1905us (2162us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788918632.131587:0:5927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 67 00000100:00100000:3.0:1788918632.135351:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918632.135490:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855215872 00000100:00100000:1.0:1788918632.135504:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855215872 00000100:00100000:1.0:1788918632.135589:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00100000:1.0:1788918632.135602:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5146850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+21:12234:x1875816855215872:12345-192.168.202.49@tcp:35:umount.0 00000100:00100000:1.0:1788918632.135923:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5146850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+22:12234:x1875816855215872:12345-192.168.202.49@tcp:35:umount.0 Request processed in 322us (586us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788918632.135955:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00100000:0.0:1788918632.139161:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918632.139312:0:5928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855216128 00000100:00100000:1.0:1788918632.139324:0:5928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855216128 00000100:00100000:1.0:1788918632.139406:0:5928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:1.0:1788918632.139418:0:5928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+22:12234:x1875816855216128:12345-192.168.202.49@tcp:35:umount.0 00000100:00100000:1.0:1788918632.139823:0:5928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9b921db9-4859-438b-976e-b950f67eace4+23:12234:x1875816855216128:12345-192.168.202.49@tcp:35:umount.0 Request processed in 405us (682us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788918632.139832:0:5928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:0.0:1788918632.144481:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918632.144537:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918632.144566:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918632.144611:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918632.144669:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855216896 00000100:00100000:0.0:1788918632.144682:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855216896 00000100:00100000:0.0:1788918632.144759:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 74 00000100:00100000:0.0:1788918632.144774:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+7:2348:x1875816855216896:12345-192.168.202.49@tcp:9:umount.0 00000020:00000080:0.0:1788918632.144824:0:6911:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac927d 00000020:00010000:0.0:1788918632.144836:0:6911:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94ffc70cb800: total 0 00000100:00080000:0.0:1788918632.144843:0:6911:0:(import.c:65:import_set_state_nolock()) ffff94fffdafd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788918632.144954:0:6911:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788918632.145085:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855216256 00000100:00100000:2.0:1788918632.145091:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855216256 00000100:00100000:2.0:1788918632.145136:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855216512 00000100:00100000:2.0:1788918632.145139:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855216512 00000100:00100000:2.0:1788918632.145161:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855216384 00000100:00100000:2.0:1788918632.145164:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855216384 00000100:00100000:2.0:1788918632.145181:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:2.0:1788918632.145199:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89208175-5136-4226-96dc-dc05cbfafbe9+15:2350:x1875816855216256:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918632.145214:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918632.145244:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffefbf4e00/0x2811b8b2b0ac8ccd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02dc expref: 15 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918632.145330:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918632.145402:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89208175-5136-4226-96dc-dc05cbfafbe9+14:2350:x1875816855216256:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 213us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918632.145410:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:2.0:1788918632.145432:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:2.0:1788918632.145438:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5094850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89208175-5136-4226-96dc-dc05cbfafbe9+13:2350:x1875816855216512:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918632.145446:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918632.145458:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fffcbc5800/0x2811b8b2b0ac8f19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03a7 expref: 13 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918632.145467:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918632.145487:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5094850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89208175-5136-4226-96dc-dc05cbfafbe9+12:2350:x1875816855216512:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 50us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918632.145494:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:2.0:1788918632.145548:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:2.0:1788918632.145555:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89208175-5136-4226-96dc-dc05cbfafbe9+11:2350:x1875816855216384:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918632.145572:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918632.145582:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0ac8c95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02a4 expref: 11 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918632.145591:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918632.145608:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89208175-5136-4226-96dc-dc05cbfafbe9+10:2350:x1875816855216384:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 54us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918632.145614:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:0.0:1788918632.146092:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9b921db9-4859-438b-976e-b950f67eace4+5:2348:x1875816855216896:12345-192.168.202.49@tcp:9:umount.0 Request processed in 1321us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918632.146101:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 74 00000020:00010000:3.0:1788918632.146422:0:5913:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94ffc70cb800: total 0 00010000:00010000:3.0:1788918632.146488:0:5913:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94ffc70cb800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788918632.146552:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5edd82d/0x2811b8b2b0ac9d04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0774 expref: 4 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918632.146592:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0ac9635 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0591 expref: 3 pid: 6909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918632.146607:0:5913:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94ffc70cb800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788918632.146622:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918632.146625:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918632.146627:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918632.153481:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918632.153611:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855217024 00000100:00100000:1.0:1788918632.153626:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855217024 00000100:00100000:1.0:1788918632.153712:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 75 00000100:00100000:1.0:1788918632.153726:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+5:2348:x1875816855217024:12345-192.168.202.49@tcp:9:umount.0 00000020:00000080:1.0:1788918632.153777:0:6909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac96dd 00000100:00080000:1.0:1788918632.153790:0:6909:0:(import.c:65:import_set_state_nolock()) ffff94ffd0671000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788918632.153867:0:6909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1788918632.153915:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918632.154150:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9b921db9-4859-438b-976e-b950f67eace4+2:2348:x1875816855217024:12345-192.168.202.49@tcp:9:umount.0 Request processed in 424us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918632.154159:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 75 00000100:00100000:3.0:1788918632.172763:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918632.172923:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855218048 00000100:00100000:0.0:1788918632.172937:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855218048 00000100:00100000:0.0:1788918632.173085:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 246 00000100:00100000:0.0:1788918632.173110:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+23:2348:x1875816855218048:12345-192.168.202.49@tcp:39:umount.0 00000020:00000080:0.0:1788918632.173162:0:5925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8ca3 00000020:00010000:0.0:1788918632.173184:0:5925:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94fffdbe6000: total 0 00000100:00080000:0.0:1788918632.173190:0:5925:0:(import.c:65:import_set_state_nolock()) ffff94ffff795800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788918632.173228:0:5925:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788918632.173477:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9b921db9-4859-438b-976e-b950f67eace4+22:2348:x1875816855218048:12345-192.168.202.49@tcp:39:umount.0 Request processed in 380us (729us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788918632.173486:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 246 00000020:00010000:1.0:1788918632.174078:0:5913:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94fffdbe6000: total 0 00010000:00010000:1.0:1788918632.174085:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918632.174163:0:5913:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94fffdbe6000, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1788918632.174204:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:1.0:1788918632.174208:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788918632.174219:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20200/0x2811b8b2b0ac9be5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0727 expref: 21 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174274:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:1.0:1788918632.174278:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788918632.174283:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21400/0x2811b8b2b0ac9ce1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0766 expref: 20 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174304:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918632.174307:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788918632.174311:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21600/0x2811b8b2b0ac9620 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f058a expref: 19 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174326:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:1.0:1788918632.174329:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788918632.174333:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb20000/0x2811b8b2b0ac92d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f04aa expref: 18 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174347:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94fffbdf3600) 00010000:00010000:1.0:1788918632.174349:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788918632.174353:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc000/0x2811b8b2b0ac8f89 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03bc expref: 17 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174376:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:1.0:1788918632.174379:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788918632.174384:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0ac96b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05b4 expref: 16 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174400:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918632.174403:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788918632.174415:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0ac9516 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0544 expref: 15 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174437:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94fff681c800) 00010000:00010000:1.0:1788918632.174440:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788918632.174445:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcb21200/0x2811b8b2b0ac8f6d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03b5 expref: 14 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174465:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:1.0:1788918632.174467:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788918632.174471:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4600/0x2811b8b2b0ac9cb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f075f expref: 13 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174484:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94fff4b4e800) 00010000:00010000:1.0:1788918632.174487:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788918632.174491:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0ac99a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f068d expref: 12 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174510:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ffff5d1000) 00010000:00010000:1.0:1788918632.174513:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788918632.174517:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc400/0x2811b8b2b0ac9697 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f05ad expref: 11 pid: 11359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174529:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94fffca17a00) 00010000:00010000:1.0:1788918632.174532:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788918632.174536:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc600/0x2811b8b2b0ac9cef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f076d expref: 10 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174550:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94fff4b4e100) 00010000:00010000:1.0:1788918632.174558:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788918632.174563:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4200/0x2811b8b2b0ac8fdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03d1 expref: 9 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174580:0:5913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94ffe293d700) 00010000:00010000:1.0:1788918632.174583:0:5913:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788918632.174587:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4a00/0x2811b8b2b0ac95f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f057c expref: 8 pid: 5925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918632.174600:0:5913:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94fffdbe6000, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1788918632.174615:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918632.174617:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918632.174619:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918633.110459:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918634.134653:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918634.638599:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918634.638666:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918634.638711:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918634.643935:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855218304 00000100:00100000:0.0:1788918634.643958:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855218304 00000100:00100000:0.0:1788918634.644173:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855218176 00000100:00100000:0.0:1788918634.644178:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855218176 00000100:00100000:0.0:1788918634.644208:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855218432 00000100:00100000:0.0:1788918634.644212:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855218432 00000100:00100000:0.0:1788918634.644250:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:0.0:1788918634.644263:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:89208175-5136-4226-96dc-dc05cbfafbe9+12:2350:x1875816855218304:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918634.644287:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918634.644312:0:8796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1492e00/0x2811b8b2b0ac8d7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f031b expref: 12 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918634.644336:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918634.644420:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:89208175-5136-4226-96dc-dc05cbfafbe9+11:2350:x1875816855218304:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 160us (5840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918634.644428:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:0.0:1788918634.644777:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:0.0:1788918634.644806:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:89208175-5136-4226-96dc-dc05cbfafbe9+10:2350:x1875816855218176:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918634.644817:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918634.644829:0:8796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1492400/0x2811b8b2b0ac8d75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02f1 expref: 10 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918634.644841:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918634.644866:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:89208175-5136-4226-96dc-dc05cbfafbe9+9:2350:x1875816855218176:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 62us (6200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918634.644872:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:0.0:1788918634.644885:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:0.0:1788918634.644892:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:89208175-5136-4226-96dc-dc05cbfafbe9+8:2350:x1875816855218432:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918634.644900:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918634.644909:0:8796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dda00/0x2811b8b2b0ac8f12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f03a0 expref: 8 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918634.644918:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918634.644937:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:89208175-5136-4226-96dc-dc05cbfafbe9+7:2350:x1875816855218432:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 44us (6226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918634.644942:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:1.0:1788918634.658855:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918634.659247:0:5926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855218688 00000100:00100000:2.0:1788918634.659263:0:5926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855218688 00000100:00100000:2.0:1788918634.659375:0:5926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 247 00000100:00100000:2.0:1788918634.659390:0:5926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+6:2348:x1875816855218688:12345-192.168.202.49@tcp:39:umount.0 00000020:00000080:2.0:1788918634.659460:0:5926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8d8a 00000020:00010000:2.0:1788918634.659473:0:5926:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94ffff790000: total 0 00000100:00080000:2.0:1788918634.659481:0:5926:0:(import.c:65:import_set_state_nolock()) ffff94ffff793000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788918634.659521:0:5926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1788918634.659748:0:5926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f5e9986-ae14-4727-8c8d-118c4f66c180+5:2348:x1875816855218688:12345-192.168.202.49@tcp:39:umount.0 Request processed in 360us (907us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788918634.659756:0:5926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 247 00000100:00080000:0.0:1788918634.660341:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1788918634.661091:0:5912:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94ffff790000: total 0 00010000:00010000:3.0:1788918634.661173:0:5912:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94ffff790000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788918634.661258:0:5912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94ffff5d1000) 00010000:00010000:3.0:1788918634.661263:0:5912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788918634.661289:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0ac9d12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f077b expref: 4 pid: 5926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918634.661323:0:5912:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94ffff790000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788918634.661337:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918634.661340:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918634.661341:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918634.682696:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918634.689932:0:5918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855218944 00000100:00100000:1.0:1788918634.689962:0:5918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855218944 00000100:00100000:1.0:1788918634.690102:0:5918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 305 00000100:00100000:1.0:1788918634.690117:0:5918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+7:2348:x1875816855218944:12345-192.168.202.49@tcp:251:umount.0 00000020:00000080:1.0:1788918634.690201:0:5918:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8c80 00000020:00010000:1.0:1788918634.690215:0:5918:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94ffff796000: total 0 00000100:00080000:1.0:1788918634.690222:0:5918:0:(import.c:65:import_set_state_nolock()) ffff94ffff791000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788918634.690580:0:5913:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94ffff796000: total 0 00010000:00010000:3.0:1788918634.690587:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918634.690699:0:5913:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94ffff796000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788918634.690751:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dd200/0x2811b8b2b0ac8cd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f02e3 expref: 3 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918634.690772:0:5913:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94ffff796000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788918634.690784:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918634.690786:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918634.690788:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918634.691008:0:5918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89208175-5136-4226-96dc-dc05cbfafbe9+1:2348:x1875816855218944:12345-192.168.202.49@tcp:251:umount.0 Request processed in 893us (8327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918634.691048:0:5918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 305 00000020:00000080:1.0:1788918634.691061:0:5918:0:(genops.c:885:class_export_put()) final put ffff94ffff796000/89208175-5136-4226-96dc-dc05cbfafbe9 00000020:00000080:0.0:1788918634.691211:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffff796000/89208175-5136-4226-96dc-dc05cbfafbe9 for MGS 00000020:00000080:0.0:1788918634.691272:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffff791000 for MGS 00010000:00010000:3.0:1788918635.159286:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788918635.609708:0:5903:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5f5e9986-ae14-4727-8c8d-118c4f66c180 00000001:00080000:2.0:1788918635.609734:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788918635.609742:0:5903:0:(genops.c:885:class_export_put()) final put ffff94ffff790000/5f5e9986-ae14-4727-8c8d-118c4f66c180 00000001:00100000:2.0:1788918635.609771:0:5903:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00000001:00080000:2.0:1788918635.609779:0:5903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1788918635.609797:0:5903:0:(genops.c:885:class_export_put()) final put ffff94fffdbe6000/9b921db9-4859-438b-976e-b950f67eace4 00000020:00000080:3.0:1788918635.609852:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffff790000/5f5e9986-ae14-4727-8c8d-118c4f66c180 for lustre-MDT0000 00000020:00000080:3.0:1788918635.609936:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffdbe6000/9b921db9-4859-438b-976e-b950f67eace4 for lustre-MDT0000 00000020:00000080:3.0:1788918635.609985:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffff793000 for lustre-MDT0000 00000020:00000080:3.0:1788918635.609990:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffff795800 for lustre-MDT0000 00000100:00100000:1.0:1788918636.118376:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865680640:0@lo:400:kworker.0 00000100:00100000:1.0:1788918636.118489:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918636.118558:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865681152:0@lo:400:kworker.0 00000100:00100000:1.0:1788918636.118589:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918636.118626:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788918636.118633:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865680768:0@lo:400:kworker.0 00000100:00100000:1.0:1788918636.118656:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918636.118695:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865680640 00000100:00100000:1.0:1788918636.118705:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865680640 00000100:00100000:1.0:1788918636.118759:0:5925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865680768 00000100:00100000:1.0:1788918636.118762:0:5925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865680768 00000100:00100000:1.0:1788918636.118802:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788918636.118813:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865680640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918636.118874:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865680640:12345-0@lo:400:kworker.0 Request processed in 63us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918636.118882:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788918636.118902:0:5925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788918636.118908:0:5925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865680768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918636.118936:0:5925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865680768:12345-0@lo:400:kworker.0 Request processed in 29us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918636.118941:0:5925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788918636.118961:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865681152 00000100:00100000:1.0:1788918636.118964:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865681152 00000100:00100000:1.0:1788918636.118995:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788918636.119002:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865681152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918636.119058:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865681152:12345-0@lo:400:kworker.0 Request processed in 57us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918636.119064:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1788918636.119085:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788918636.119097:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918636.119137:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865680768:0@lo:400:kworker.0 00000100:00100000:1.0:1788918636.119149:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865680640:0@lo:400:kworker.0 00000100:00100000:1.0:1788918636.119158:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865681152:0@lo:400:kworker.0 00000100:00100000:3.0:1788918636.123331:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865680512:0@lo:400:kworker.0 00000100:00100000:3.0:1788918636.123449:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918636.123510:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865681024:0@lo:400:kworker.0 00000100:00100000:3.0:1788918636.123543:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918636.123593:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788918636.123602:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865680896:0@lo:400:kworker.0 00000100:00100000:3.0:1788918636.123639:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918636.123679:0:11359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865681024 00000100:00100000:3.0:1788918636.123689:0:11359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865681024 00000100:00100000:3.0:1788918636.123857:0:11359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788918636.123868:0:11359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865681024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918636.123931:0:11359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865681024:12345-0@lo:400:kworker.0 Request processed in 65us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918636.123939:0:11359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788918636.124174:0:5916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865680512 00000100:00100000:3.0:1788918636.124179:0:5916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865680512 00000100:00100000:3.0:1788918636.124208:0:5916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788918636.124215:0:5916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865680512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918636.124263:0:5916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc512f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865680512:12345-0@lo:400:kworker.0 Request processed in 48us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918636.124269:0:5916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788918636.124304:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865680896 00000100:00100000:3.0:1788918636.124308:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865680896 00000100:00100000:3.0:1788918636.124340:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788918636.124346:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865680896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918636.124377:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865680896:12345-0@lo:400:kworker.0 Request processed in 31us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918636.124384:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788918636.124400:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788918636.124405:0:5920:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918636.124444:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865680896:0@lo:400:kworker.0 00000100:00100000:3.0:1788918636.124466:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865680512:0@lo:400:kworker.0 00000100:00100000:3.0:1788918636.124477:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865681024:0@lo:400:kworker.0 00000100:00100000:1.0:1788918636.128719:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865681280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918636.128828:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918636.129179:0:6913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865681280 00000100:00100000:2.0:1788918636.129191:0:6913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865681280 00000100:00100000:2.0:1788918636.129266:0:6913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788918636.129279:0:6913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865681280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788918636.129327:0:6913:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923660800 avail 3692138496 00000100:00100000:2.0:1788918636.129400:0:6913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865681280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918636.129408:0:6913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788918636.129633:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865681280:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788918636.187654:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788918636.906696:0:13301:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788918636.941435:0:13301:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788918636.941492:0:13301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918636.941506:0:13301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918636.941514:0:13301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918636.941521:0:13301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918636.941548:0:13301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788918636.941553:0:13301:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788918636.941578:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788918636.941583:0:13301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788918636.941589:0:13301:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788918636.941613:0:13301:0:(import.c:65:import_set_state_nolock()) ffff94fffc8e6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788918636.941647:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1875816865681408:0@lo:39:umount.0 00000100:00100000:3.0:1788918636.941716:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788918636.944053:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918636.944067:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.944079:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4000 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918636.944083:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.944094:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918636.944101:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918636.944106:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788918636.944109:0:5912:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788918636.944112:0:5912:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788918636.944153:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.944177:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918636.944210:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.944227:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4000/0x2811b8b2b0ac8d13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8d1a expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.944244:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918636.944246:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918636.944248:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918636.944266:0:5924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865681408 00000100:00100000:1.0:1788918636.944273:0:5924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865681408 00000100:00100000:1.0:1788918636.944327:0:5924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788918636.944337:0:5924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3416:x1875816865681408:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788918636.944361:0:5924:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8a8f 00000100:00080000:1.0:1788918636.944369:0:5924:0:(import.c:65:import_set_state_nolock()) ffff94ffe8d50000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788918636.944516:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865681536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788918636.944932:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918636.945053:0:8796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865681536 00000100:00100000:0.0:1788918636.945059:0:8796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865681536 00000100:00100000:0.0:1788918636.945101:0:8796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788918636.945109:0:8796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3419:x1875816865681536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788918636.945128:0:8796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918636.945143:0:8796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1493e00/0x2811b8b2b0ac8d1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d13 expref: 19 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.945159:0:8796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918636.945194:0:8796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:74aa73a2-313d-4992-b461-72ab8c3ab246+18:3419:x1875816865681536:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918636.945202:0:8796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788918636.945327:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865681536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788918636.945549:0:5924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3416:x1875816865681408:12345-0@lo:39:umount.0 Request processed in 1212us (3831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918636.945556:0:5924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000020:00000080:1.0:1788918636.945564:0:5924:0:(genops.c:885:class_export_put()) final put ffff94fffc886000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788918636.945592:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788918636.945624:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffc886000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788918636.945674:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffe8d50000 for lustre-MDT0000 00000100:00080000:3.0:1788918636.945725:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94fffc8e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788918636.945742:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1875816865681408:0@lo:39:umount.0 00000100:00080000:0.0:1788918636.945815:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788918636.945819:0:13301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788918636.945824:0:13301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788918636.947331:0:13301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.947350:0:13301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.947357:0:13301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.947364:0:13301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.947494:0:13301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788918636.947502:0:13301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.947510:0:13301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.947533:0:13301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.947539:0:13301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.947593:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788918636.947600:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.947607:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1493600 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918636.947611:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.947629:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918636.947637:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918636.947642:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788918636.947644:0:5912:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788918636.947671:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.947678:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788918636.947737:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffeff6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865681664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788918636.947796:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788918636.947869:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.947878:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1493600/0x2811b8b2b0ac8d21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8d28 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.947894:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918636.947898:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.947904:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1528c00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918636.947908:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.947916:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918636.947923:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918636.947934:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788918636.947937:0:5912:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1788918636.947950:0:5912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.947956:0:5912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918636.947971:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.947978:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918636.947979:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918636.947981:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918636.947992:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865681792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788918636.948041:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918636.948126:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865681664 00000100:00100000:3.0:1788918636.948133:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865681664 00000100:00100000:3.0:1788918636.948180:0:7989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865681792 00000100:00100000:3.0:1788918636.948184:0:7989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865681792 00000100:00100000:3.0:1788918636.948213:0:7989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788918636.948231:0:7989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+19:3420:x1875816865681664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788918636.948243:0:7989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918636.948257:0:7989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff691ec00/0x2811b8b2b0ac8d28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d21 expref: 19 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918636.948269:0:7989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918636.948325:0:5909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788918636.948334:0:5909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5096c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+18:3417:x1875816865681792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788918636.948342:0:5909:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918636.948351:0:5909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc0031000/0x2811b8b2b0ac8c41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8c3a expref: 18 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.948365:0:5909:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918636.948391:0:5909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5096c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74aa73a2-313d-4992-b461-72ab8c3ab246+17:3417:x1875816865681792:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918636.948397:0:5909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788918636.948444:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74aa73a2-313d-4992-b461-72ab8c3ab246:3417:1875816865681792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788918636.948564:0:13301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788918636.948569:0:13301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1528c00/0x2811b8b2b0ac8c3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8c41 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918636.948583:0:13301:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788918636.948605:0:13301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.948612:0:13301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.948618:0:13301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.948625:0:13301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.948636:0:13301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788918636.948641:0:13301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac89ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.948647:0:13301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac89ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.948660:0:13301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac89ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.948666:0:13301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac89ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918636.948673:0:13301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788918636.948676:0:13301:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788918636.948679:0:13301:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788918636.948706:0:13301:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788918636.948710:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788918636.948714:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788918636.948720:0:13301:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788918636.948725:0:13301:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff94ffff5e3800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788918636.948731:0:13301:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff94ffef800800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788918636.948736:0:13301:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff94ffc91319c0) has exports, disconnecting them 00000020:00080000:0.0:1788918636.948741:0:13301:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94ffff5e3800), last request at 1788918636 00000020:00000080:0.0:1788918636.948747:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8c02 00000100:00080000:0.0:1788918636.948764:0:13301:0:(import.c:65:import_set_state_nolock()) ffff94ffff5e3000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788918636.948801:0:13301:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94ffff5e3800): rc 0 00000020:00000080:0.0:1788918636.948803:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffff5e3800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788918636.948811:0:13301:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94ffef800800), last request at 1788918636 00000020:00000080:0.0:1788918636.948814:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8b37 00000100:00080000:0.0:1788918636.948819:0:13301:0:(import.c:65:import_set_state_nolock()) ffff94ffef801800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788918636.948825:0:13301:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94ffef800800): rc 0 00000020:00000080:0.0:1788918636.948827:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffef800800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788918636.948833:0:13301:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa86d80d17ae0 00000100:00080000:0.0:1788918636.948859:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788918636.948863:0:13301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788918636.948876:0:13301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788918636.948945:0:13301:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788918636.948960:0:13301:0:(import.c:65:import_set_state_nolock()) ffff94fff6869800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788918636.948974:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788918636.948977:0:13301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788918636.948984:0:13301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788918636.949075:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865681920:0@lo:9:umount.0 00000100:00100000:0.0:1788918636.949113:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918636.949150:0:6911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865681920 00000100:00100000:0.0:1788918636.949154:0:6911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865681920 00000100:00100000:0.0:1788918636.949184:0:6911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788918636.949191:0:6911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3416:x1875816865681920:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788918636.949211:0:6911:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8b92 00000100:00080000:0.0:1788918636.949227:0:6911:0:(import.c:65:import_set_state_nolock()) ffff94fffcb1b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788918636.949256:0:6911:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788918636.949374:0:6911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3416:x1875816865681920:12345-0@lo:9:umount.0 Request processed in 183us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918636.949381:0:6911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788918636.949426:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94fff6869800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788918636.949435:0:3416:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788918636.949436:0:3416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788918636.949440:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865681920:0@lo:9:umount.0 00000100:00080000:0.0:1788918636.949459:0:13301:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788918636.949469:0:13301:0:(import.c:65:import_set_state_nolock()) ffff94fffc8e5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788918636.949484:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865682048:0@lo:9:umount.0 00000100:00100000:0.0:1788918636.949524:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918636.949638:0:6909:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865682048 00000100:00100000:0.0:1788918636.949642:0:6909:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865682048 00000100:00100000:0.0:1788918636.949668:0:6909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788918636.949674:0:6909:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3416:x1875816865682048:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788918636.949687:0:6909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8c6b 00000100:00080000:0.0:1788918636.949692:0:6909:0:(import.c:65:import_set_state_nolock()) ffff94ffff5e0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788918636.949707:0:6909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788918636.949785:0:6909:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3416:x1875816865682048:12345-0@lo:9:umount.0 Request processed in 111us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918636.949792:0:6909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788918636.949818:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94fffc8e5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788918636.949822:0:3416:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788918636.949824:0:3416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788918636.949826:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865682048:0@lo:9:umount.0 00000020:00080000:0.0:1788918636.949894:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff94ffc91319c0) has no exports 00010000:00010000:1.0:1788918636.951539:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788918636.951551:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.951573:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4c00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918636.951577:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.951587:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918636.951594:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918636.951600:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788918636.951602:0:5913:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788918636.951606:0:5913:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788918636.951644:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.951649:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918636.951678:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.951685:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0ac8f3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8f43 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.951700:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918636.951704:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac89ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.951709:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030200 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918636.951711:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac89ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.951724:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac89ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918636.951730:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac89ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918636.951735:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788918636.951737:0:5913:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788918636.951739:0:5913:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788918636.951751:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac89ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.951757:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788918636.951829:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865682176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788918636.951887:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788918636.955679:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffff5e3800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788918636.955734:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffef800800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788918636.955773:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffff5e3000 for lustre-MDT0000 00000020:00000080:0.0:1788918636.955778:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffef801800 for lustre-MDT0000 00010000:00010000:0.0:1788918636.955796:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918636.957624:0:7989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3420:x1875816865681664:12345-0@lo:103:ldlm_bl.0 Request processed in 9381us (9814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918636.957640:0:7989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788918636.959144:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffeff6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865681664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788918636.959172:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788918636.959185:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865682304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788918636.959256:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918636.959317:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865682176 00000100:00100000:2.0:1788918636.959323:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865682176 00000100:00100000:2.0:1788918636.959372:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865682304 00000100:00100000:2.0:1788918636.959375:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865682304 00000100:00100000:2.0:1788918636.959392:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788918636.959400:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+17:3418:x1875816865682176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788918636.959425:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918636.959444:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fffcb20e00/0x2811b8b2b0ac8f43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8f3c expref: 17 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918636.959478:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918636.959514:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+16:3418:x1875816865682176:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (7626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918636.959521:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788918636.959536:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788918636.959542:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+15:3420:x1875816865682304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788918636.959551:0:5911:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918636.959559:0:5911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1481200/0x2811b8b2b0ac89f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac89ee expref: 15 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918636.959572:0:5911:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918636.959599:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74aa73a2-313d-4992-b461-72ab8c3ab246+14:3420:x1875816865682304:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918636.959604:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788918636.959646:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74aa73a2-313d-4992-b461-72ab8c3ab246:3420:1875816865682304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788918636.959667:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74aa73a2-313d-4992-b461-72ab8c3ab246:3418:1875816865682176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788918636.960120:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac89ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.960130:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac89ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac89f5 expref: -99 pid: 5901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918636.960146:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918636.960149:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918636.960151:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788918636.967486:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff94ffc91319c0) has no exports 00000020:00000080:0.0:1788918637.049945:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8a49 00000020:00000080:0.0:1788918637.050280:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffe8d57000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788918637.050338:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788918637.050575:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788918637.050587:0:13301:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788918637.050592:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff94fffbdd99c0) has no exports 00000020:00000080:1.0:1788918637.051048:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8a42 00000020:00000080:1.0:1788918637.051063:0:13301:0:(genops.c:885:class_export_put()) final put ffff94fffc881000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788918637.051203:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffe8d57000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788918637.051739:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffc881000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788918637.051809:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788918637.051818:0:13301:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788918637.051822:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffc5b44800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788918637.051839:0:13301:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffc5b44800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788918637.051846:0:13301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788918637.052381:0:13301:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94ffff636240 - data ffff94fff8efa5e8/ffff94fff69a3400 00000020:01000000:1.0:1788918637.052537:0:13301:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94ffd077a540 - data ffff94fff8d28798/ffff94fffca32000 00000001:00000004:1.0:1788918637.065299:0:13301:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1788918637.112170:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788918637.112180:0:13301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788918637.112197:0:13301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788918637.112207:0:13301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788918637.112621:0:7253:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788918637.112626:0:7253:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1788918637.112640:0:7253:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788918637.113120:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788918637.113125:0:13301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788918637.113138:0:13301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788918637.113140:0:13301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788918637.113455:0:8365:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788918637.113459:0:8365:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1788918637.113468:0:8365:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788918637.114457:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8a11 00000020:00000080:0.0:1788918637.114468:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffe8db5800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788918637.115269:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffe8db5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788918637.116944:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8a26 00000020:00000080:0.0:1788918637.116957:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffe8db2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788918637.116966:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788918637.116971:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788918637.116979:0:13301:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788918637.116983:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff94ffc9133380) has no exports 00000020:00000080:2.0:1788918637.117085:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffe8db2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1788918637.117329:0:13301:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788918637.117338:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8c64 00000020:00000080:0.0:1788918637.117343:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffff794800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788918637.117356:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788918637.117359:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788918637.117366:0:13301:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788918637.117369:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff94fffca3cd40) has no exports 00000020:00000080:0.0:1788918637.117375:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8c5d 00000020:00000080:0.0:1788918637.117380:0:13301:0:(genops.c:885:class_export_put()) final put ffff94fffc8e5800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788918637.117713:0:13301:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788918637.117717:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788918637.117721:0:13301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788918637.117726:0:13301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788918637.117728:0:13301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788918637.117754:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788918637.117760:0:13301:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788918637.117765:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8b7d 00000020:00000080:0.0:1788918637.117769:0:13301:0:(genops.c:885:class_export_put()) final put ffff94fffdaff000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788918637.117772:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788918637.117776:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788918637.117785:0:13301:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788918637.117787:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff94fffc9bcd40) has no exports 00000020:00000080:0.0:1788918637.117791:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8b76 00000020:00000080:0.0:1788918637.117794:0:13301:0:(genops.c:885:class_export_put()) final put ffff94fff686c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788918637.118444:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffff794800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788918637.118456:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffc8e5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788918637.118469:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94fffc8e5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788918637.118475:0:36:0:(genops.c:885:class_export_put()) final put ffff94ffff5fd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788918637.118477:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffff5fd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788918637.118482:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788918637.118586:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffdaff000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788918637.118593:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94fff686c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788918637.118746:0:13301:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788918637.118750:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788918637.118753:0:13301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788918637.118759:0:13301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788918637.118760:0:13301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788918637.118835:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788918637.118844:0:13301:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788918637.118877:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788918637.118880:0:13301:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788918637.118883:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffd0567800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788918637.118886:0:13301:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffd0567800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788918637.118891:0:13301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788918637.119065:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8a2d 00000020:00000080:0.0:1788918637.119073:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffe8db3000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788918637.119475:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94fff6869800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788918637.119482:0:36:0:(genops.c:885:class_export_put()) final put ffff94fffdbe2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788918637.119484:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffdbe2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788918637.119490:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788918637.119626:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788918637.119632:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788918637.119637:0:13301:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788918637.119641:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff94ffe8db99c0) has no exports 00000020:00000080:0.0:1788918637.119660:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788918637.119664:0:13301:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788918637.119667:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8a34 00000020:00000080:0.0:1788918637.119671:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffe8db3800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788918637.119926:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffe8db3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788918637.119931:0:36:0:(genops.c:885:class_export_put()) final put ffff94ffe8db4000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788918637.119933:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffe8db4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788918637.119938:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1788918637.120353:0:13301:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94fffbe70000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788918637.120358:0:13301:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94fffbe70000 3 00000020:01000004:0.0:1788918637.120362:0:13301:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94fffbe70000 from lustre-MDT0000 00000020:00000080:0.0:1788918637.120383:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788918637.120388:0:13301:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788918637.120391:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffe8db7800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788918637.120402:0:13301:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffe8db7800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788918637.120409:0:13301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788918637.120445:0:13301:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788918637.120450:0:13301:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788918637.120453:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788918637.120456:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788918637.120459:0:13301:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788918637.120465:0:13301:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff94ffc5063000 74aa73a2-313d-4992-b461-72ab8c3ab246 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788918637.120470:0:13301:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff94ffc9134d40) has exports, disconnecting them 00000020:00080000:0.0:1788918637.120475:0:13301:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff94ffc5063000), last request at 1788918404 00000020:00000080:0.0:1788918637.120489:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac89d2 00000020:00010000:0.0:1788918637.120494:0:13301:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94ffc5063000: total 1 00000100:00080000:0.0:1788918637.120498:0:13301:0:(import.c:65:import_set_state_nolock()) ffff94ffc5062800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788918637.120519:0:13301:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94ffc5063000): rc 0 00000020:00080000:0.0:1788918637.120523:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff94ffc9134d40) has no exports 00000020:00010000:3.0:1788918637.120584:0:5912:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94ffc5063000: total 1 00010000:00010000:3.0:1788918637.120625:0:5912:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94ffc5063000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788918637.120657:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff691e200/0x2811b8b2b0ac8cfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8cf7 expref: 9 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918637.120672:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff691ee00/0x2811b8b2b0ac8cf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8ce9 expref: 8 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918637.120684:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dd400/0x2811b8b2b0ac8f27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8f20 expref: 7 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918637.120708:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff691f200/0x2811b8b2b0ac8d0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d05 expref: 6 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918637.120719:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffefbf5400/0x2811b8b2b0ac8d36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8d2f expref: 5 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918637.120729:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac8f35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8f2e expref: 4 pid: 5918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918637.120742:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc1528600/0x2811b8b2b0ac8aea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8ae3 expref: 3 pid: 5916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918637.120754:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff691e400/0x2811b8b2b0ac8ce2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2811b8b2b0ac8cdb expref: 2 pid: 5917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918637.120764:0:5912:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94ffc5063000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788918637.120780:0:5912:0:(genops.c:885:class_export_put()) final put ffff94ffc5063000/74aa73a2-313d-4992-b461-72ab8c3ab246 00000100:00100000:0.0:1788918637.121256:0:5918:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff94ffe22d2400:5918] 2 exiting: rc = 0 00000100:00100000:0.0:1788918637.121364:0:5916:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff94ffd80b9400:5916] 0 exiting: rc = 1 00000020:00000080:2.0:1788918637.121528:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffe8db3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1788918637.121562:0:5917:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff94ffd80b9800:5917] 1 exiting: rc = 0 00000100:00100000:0.0:1788918637.121666:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121674:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121680:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121686:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121693:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121698:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121704:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121709:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121714:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121720:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121727:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121733:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121738:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121744:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121748:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121765:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121771:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121778:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121784:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121790:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121796:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121802:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121808:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121814:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121820:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121826:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121831:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121836:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121843:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121849:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121855:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121860:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121865:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121871:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121877:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121883:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121888:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121893:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121898:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121904:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121910:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121915:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121921:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121926:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121930:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121936:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121942:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121947:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121952:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121958:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121972:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121977:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121982:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121987:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121992:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.121997:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.122002:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.122008:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.122013:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.122046:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.122052:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.122065:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.122070:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.122076:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788918637.123557:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918637.123562:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918637.123565:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788918637.123598:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffc5063000/74aa73a2-313d-4992-b461-72ab8c3ab246 for MGS 00000020:00000080:2.0:1788918637.123646:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffc5062800 for MGS 00000020:01000000:3.0:1788918637.123725:0:13301:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94ffff636060 - data ffff94fff8efa0d8/ffff94fff69a2c00 00000020:01000000:3.0:1788918637.123846:0:13301:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94ffc92939c0 - data ffff94ffc22e86c0/ffff94fffbe6dc00 00000020:00000080:3.0:1788918637.124387:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac89b6 00000020:00000080:3.0:1788918637.124395:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffd0566000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788918637.124442:0:13301:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94fffbe70000 from MGS, refs=2 00000020:01000004:3.0:1788918637.124446:0:13301:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94fffbe70000 2 00000020:01000004:3.0:1788918637.124450:0:13301:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94fffbe70000 from MGS 00000020:00000080:3.0:1788918637.124474:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788918637.124481:0:13301:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788918637.124485:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffd0566800/MGS 00000020:00000080:3.0:1788918637.124500:0:13301:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffd0566800/MGS for MGS 00000020:01000000:3.0:1788918637.124506:0:13301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788918637.124569:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788918637.124574:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788918637.124580:0:13301:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788918637.124586:0:13301:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff94ffe8db1800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788918637.124593:0:13301:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff94fffc9bb380) has exports, disconnecting them 00000020:00080000:3.0:1788918637.124597:0:13301:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff94ffe8db1800), last request at 1788918404 00000020:00000080:3.0:1788918637.124602:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8a81 00000020:00080000:3.0:1788918637.124611:0:13301:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94ffe8db1800): rc 0 00000020:00000080:3.0:1788918637.124617:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffe8db1800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788918637.124955:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffd0566000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788918637.125106:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffe8db1800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788918637.127161:0:13301:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788918637.127168:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788918637.127172:0:13301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788918637.127179:0:13301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788918637.127375:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788918637.127383:0:13301:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788918637.127389:0:13301:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94fffbe70000 1 00000020:00000080:2.0:1788918637.127395:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac89a8 00000020:00000080:2.0:1788918637.127404:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffd0567000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788918637.127410:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788918637.127423:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788918637.127427:0:13301:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788918637.127431:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff94ffc9130000) has no exports 00000020:00000080:0.0:1788918637.128161:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94fffc8e6800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788918637.128171:0:469:0:(genops.c:885:class_export_put()) final put ffff94ffe8d52800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788918637.128174:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffe8d52800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788918637.128181:0:469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788918637.128261:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffd0567000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788918637.182782:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788918637.182797:0:13301:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788918637.182804:0:13301:0:(genops.c:885:class_export_put()) final put ffff94fffbe75000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788918637.182809:0:13301:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffbe75000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788918637.182815:0:13301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788918637.182942:0:13301:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94fffbe74800 00000020:01000000:2.0:1788918637.182961:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788918637.182966:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788918637.182970:0:13301:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788918637.182974:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff94fffbddb380) has no exports 00000100:00100000:3.0:1788918637.183449:0:5925:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff94ffd809d800:5925] 1 exiting: rc = 0 00000100:00100000:1.0:1788918637.183580:0:5926:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff94ffd809da00:5926] 2 exiting: rc = 0 00000100:00100000:1.0:1788918637.183644:0:5924:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff94ffd81b7800:5924] 0 exiting: rc = 1 00000100:00100000:0.0:1788918637.183746:0:11359:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff94ffefd61c00:11359] 3 exiting: rc = 0 00000100:00100000:2.0:1788918637.183883:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183892:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183899:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183906:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183913:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183919:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183926:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183932:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183938:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183943:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183958:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183965:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183970:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183976:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183981:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183987:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183992:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.183998:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.184003:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.184009:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.184014:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185906:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185912:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185918:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185925:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185931:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185937:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185944:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185951:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185957:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185964:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185970:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185976:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185982:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185988:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.185996:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186003:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186008:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186014:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186046:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186165:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186174:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186179:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186199:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186207:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186224:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186231:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186237:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186242:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186248:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186253:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186259:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186264:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186269:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186275:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186280:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186295:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186300:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186305:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186312:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186319:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186324:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186332:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918637.186338:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.193444:0:5928:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff94ffd809d400:5928] 1 exiting: rc = 0 00000100:00100000:2.0:1788918637.193971:0:5927:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff94ffd809c200:5927] 0 exiting: rc = 1 00000100:00100000:3.0:1788918637.194453:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194463:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194471:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194480:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194486:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194491:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194497:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194584:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194591:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194597:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194602:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194608:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194615:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194621:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194626:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194632:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194637:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194642:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194646:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194652:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194658:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194676:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194682:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194687:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194692:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194697:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194701:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194707:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194711:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194716:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194721:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194726:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194732:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194736:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194741:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194747:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194752:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194756:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194761:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194766:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194771:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194776:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194781:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194786:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194790:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194795:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194799:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194804:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194809:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194814:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194819:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194824:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194828:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194833:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194838:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194843:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194854:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194859:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194864:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194869:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194874:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194879:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194884:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.194889:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.195804:0:5930:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff94ffd809c800:5930] 1 exiting: rc = 0 00000100:00100000:1.0:1788918637.195975:0:5929:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff94ffd809d000:5929] 0 exiting: rc = 1 00000100:00100000:3.0:1788918637.196186:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196194:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196200:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196206:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196219:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196226:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196232:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196245:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196252:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196257:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196263:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196269:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196275:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196280:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196286:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196291:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196297:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196303:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196310:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196331:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196338:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196343:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196350:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196356:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196362:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196368:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196374:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196390:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196396:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196402:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196409:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196429:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196436:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196442:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196447:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196453:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196460:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196466:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196472:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196477:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196482:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196487:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196492:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196526:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196534:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196540:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196546:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196552:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196558:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196565:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196571:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196577:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196583:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196589:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196595:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196614:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196622:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196629:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196635:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196640:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196646:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196651:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196663:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.196687:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788918637.207320:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918637.208531:0:5931:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff94ffd809ca00:5931] 0 exiting: rc = 1 00000100:00100000:0.0:1788918637.208696:0:5932:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff94ffd809c400:5932] 1 exiting: rc = 0 00000100:00100000:3.0:1788918637.208810:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208817:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208822:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208827:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208831:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208837:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208842:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208847:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208852:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208856:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208861:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208865:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208870:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208875:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208881:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208886:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208892:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208897:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208902:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208907:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208911:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208916:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208920:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208925:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208929:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208934:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208939:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208944:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208948:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208953:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208958:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208963:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208968:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208990:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.208994:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209000:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209005:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209010:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209016:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209221:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209227:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209231:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209236:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209241:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209246:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209251:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209256:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209261:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209266:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209271:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209276:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209280:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209285:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209290:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209295:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209300:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209305:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209310:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209316:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209321:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209326:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209331:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209335:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.209340:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.209882:0:5934:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff94ffc6055800:5934] 1 exiting: rc = 0 00000100:00100000:2.0:1788918637.210407:0:5933:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff94ffd86c7800:5933] 0 exiting: rc = 1 00000100:00100000:3.0:1788918637.210516:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210523:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210528:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210533:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210548:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210554:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210559:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210564:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210569:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210575:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210580:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210586:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210591:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210596:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210601:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210606:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210611:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210615:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210620:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210624:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210629:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210634:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210638:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210643:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210647:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210651:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210656:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210660:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210666:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210670:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210674:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210680:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210685:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210690:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210695:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210702:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210707:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210712:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210717:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210729:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210733:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210738:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210743:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210748:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210753:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210758:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210763:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210768:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210773:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210778:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210783:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210788:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210793:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210798:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210803:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210808:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210813:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210819:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210824:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210829:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210834:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210839:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210844:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.210849:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918637.211428:0:5935:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff94fffbe43400:5935] 0 exiting: rc = 1 00000100:00100000:1.0:1788918637.211669:0:5936:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff94fffbe43800:5936] 1 exiting: rc = 0 00000100:00100000:3.0:1788918637.211910:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211917:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211922:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211927:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211933:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211938:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211942:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211947:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211952:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211957:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211971:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211976:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211980:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211985:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211990:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.211995:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212000:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212005:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212011:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212016:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212254:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212260:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212266:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212271:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212276:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212281:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212286:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212290:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212295:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212300:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212306:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212310:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212316:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212321:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212327:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212333:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212338:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212343:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212349:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212355:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212361:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212367:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212371:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212376:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212382:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212394:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212400:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212405:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212410:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212415:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212420:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212425:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212430:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212434:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212439:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212444:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212449:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212454:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212460:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212464:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212470:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212475:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212479:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788918637.212484:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.213488:0:5938:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff94ffe9850600:5938] 1 exiting: rc = 0 00000100:00100000:1.0:1788918637.213779:0:5939:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff94ffe9851200:5939] 2 exiting: rc = 0 00000100:00100000:3.0:1788918637.214321:0:5937:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff94ffe9850200:5937] 0 exiting: rc = 1 00000100:00100000:1.0:1788918637.215172:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215184:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215192:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215224:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215232:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215237:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215243:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215249:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215255:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215261:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215267:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215273:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215279:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215285:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215291:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215296:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215301:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215319:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215325:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215332:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215337:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215343:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215348:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215354:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215359:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215365:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215371:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215390:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215397:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215402:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215408:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215413:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215418:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215424:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215429:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215435:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215441:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215446:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215451:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215456:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215462:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215468:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215474:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215479:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215485:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215491:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215496:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215513:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215519:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215525:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215532:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215552:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215564:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215570:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215575:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215580:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215585:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215590:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215595:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215600:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215606:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215617:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215624:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918637.215630:0:13301:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788918637.219986:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788918637.220000:0:13301:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788918637.220006:0:13301:0:(genops.c:885:class_export_put()) final put ffff94ffc70cc800/MDS_uuid 00000020:00000080:1.0:1788918637.220011:0:13301:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffc70cc800/MDS_uuid for MDS 00000020:01000000:1.0:1788918637.220016:0:13301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788918637.220343:0:13301:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:2.0:1788918637.664277:0:7980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788918637.664287:0:7980:0:(genops.c:885:class_export_put()) final put ffff94ffff5e2800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788918637.664313:0:7980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00000020:00000080:2.0:1788918637.664315:0:7980:0:(genops.c:885:class_export_put()) final put ffff94ffc70cb800/9b921db9-4859-438b-976e-b950f67eace4 00000020:00000080:0.0:1788918637.664391:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffff5e2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788918637.664441:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffc70cb800/9b921db9-4859-438b-976e-b950f67eace4 for lustre-OST0001 00000020:00000080:0.0:1788918637.664461:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffff5e0800 for lustre-OST0001 00000020:00000080:0.0:1788918637.664466:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94fffdafd800 for lustre-OST0001 00000001:00100000:0.0:1788918637.675740:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788918637.675766:0:6905:0:(genops.c:885:class_export_put()) final put ffff94fffcb18800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788918637.675799:0:6905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9b921db9-4859-438b-976e-b950f67eace4 00000020:00000080:0.0:1788918637.675802:0:6905:0:(genops.c:885:class_export_put()) final put ffff94ffd0673800/9b921db9-4859-438b-976e-b950f67eace4 00000020:00000080:2.0:1788918637.675906:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffcb18800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788918637.675962:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffd0673800/9b921db9-4859-438b-976e-b950f67eace4 for lustre-OST0000 00000020:00000080:2.0:1788918637.675980:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94fffcb1b000 for lustre-OST0000 00000020:00000080:2.0:1788918637.675986:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffd0671000 for lustre-OST0000 00010000:00010000:3.0:1788918638.230156:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918639.255616:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918640.280167:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788918641.080664:0:13503:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788918641.095622:0:13503:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788918641.095675:0:13503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918641.095692:0:13503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918641.095700:0:13503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918641.095724:0:13503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918641.095803:0:13503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788918641.095808:0:13503:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788918641.095832:0:13503:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788918641.095836:0:13503:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788918641.095841:0:13503:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788918641.095865:0:13503:0:(import.c:65:import_set_state_nolock()) ffff94fffdbe2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788918641.095945:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3416:1875816865682432:0@lo:39:umount.0 00000400:00000100:0.0:1788918641.096000:0:3416:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875816865682432 offset 0 length 224: 4 00010000:00010000:1.0:1788918641.102437:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918641.102455:0:5913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918641.102469:0:5913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5200 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918641.102474:0:5913:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918641.102486:0:5913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918641.102493:0:5913:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918641.102499:0:5913:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788918641.102521:0:5913:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788918641.102526:0:5913:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788918641.102570:0:5913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918641.102578:0:5913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918641.102617:0:5913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918641.102624:0:5913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5200/0x2811b8b2b0ac8cf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2811b8b2b0ac8cfe expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918641.102640:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918641.102642:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918641.102644:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918641.102699:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788918641.102721:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865682560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788918641.102795:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918641.102920:0:5911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865682560 00000100:00100000:1.0:1788918641.102928:0:5911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865682560 00000100:00100000:1.0:1788918641.102977:0:5911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788918641.102986:0:5911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3419:x1875816865682560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788918641.102992:0:5911:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788918641 with bad export cookie 2887291913728985554 00000100:00100000:1.0:1788918641.113680:0:5911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3419:x1875816865682560:12345-0@lo:103:ldlm_bl.0 Request processed in 10685us (10877us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788918641.113694:0:5911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788918641.113829:0:3419:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.149@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788918641.113834:0:3419:0:(import.c:65:import_set_state_nolock()) ffff94ffc8964800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788918641.113837:0:3419:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788918641.119732:0:3419:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.149@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788918641.119738:0:3419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788918641.119746:0:3419:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94ffff846d80 x1875816865682560/t0(0) o103->MGC192.168.202.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788918657 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788918641.119761:0:3419:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788918641.119764:0:3419:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788918641.119765:0:3419:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788918641.119769:0:3419:0:(import.c:65:import_set_state_nolock()) ffff94ffc8964800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788918641.119774:0:3419:0:(import.c:545:import_select_connection()) MGC192.168.202.149@tcp: connect to NID 0@lo last attempt 106 00000100:00080000:2.0:1788918641.119783:0:3419:0:(import.c:665:import_select_connection()) MGC192.168.202.149@tcp: import ffff94ffc8964800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788918641.119815:0:3419:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffffa89f80 x1875816865682688/t0(0) o250->MGC192.168.202.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788918641.119878:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74aa73a2-313d-4992-b461-72ab8c3ab246:3416:1875816865682688:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788918641.119928:0:3416:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875816865682688 offset 0 length 520: 4 00000100:00100000:2.0:1788918641.119996:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74aa73a2-313d-4992-b461-72ab8c3ab246:3419:1875816865682560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788918641.240131:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788918641.240168:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865682816:0@lo:400:kworker.0 00000400:00000100:2.0:1788918641.240230:0:3418:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875816865682816 offset 0 length 224: 4 00010000:00010000:1.0:1788918641.302335:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918642.326289:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918643.352640:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918644.376187:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918645.398294:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788918646.358391:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 74aa73a2-313d-4992-b461-72ab8c3ab246->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788918646.358401:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 74aa73a2-313d-4992-b461-72ab8c3ab246->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788918646.358522:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788918646.358542:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865682944:0@lo:400:kworker.0 00000400:00000100:1.0:1788918646.358615:0:3417:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875816865682944 offset 0 length 224: 4 00010000:00010000:1.0:1788918646.422279:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918647.447160:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918648.470451:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918649.494316:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918650.521623:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918651.478171:0:3416:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788918641/real 1788918641] req@ffff94ffffa89f80 x1875816865682688/t0(0) o250->MGC192.168.202.149@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788918651 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918651.478206:0:3416:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94ffffa89f80 x1875816865682688/t0(0) o250->MGC192.168.202.149@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788918651 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918651.478217:0:3416:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788918641/real 1788918641] req@ffff94ffffa8aa00 x1875816865682432/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788918651 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918651.478229:0:3416:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94ffffa8aa00 x1875816865682432/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788918651 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788918651.478247:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94ffc8964800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788918651.478256:0:3416:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788918651.478276:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74aa73a2-313d-4992-b461-72ab8c3ab246:3416:1875816865682688:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788918651.478282:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94fffdbe2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788918651.478305:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3416:1875816865682432:0@lo:39:umount.0 00000100:00080000:0.0:1788918651.478460:0:13503:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788918651.478465:0:13503:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788918651.478470:0:13503:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788918651.478527:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 74aa73a2-313d-4992-b461-72ab8c3ab246->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788918651.478532:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788918651.478535:0:36:0:(import.c:65:import_set_state_nolock()) ffff94ffc8964800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788918651.478540:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.149@tcp: connect to NID 0@lo last attempt 343 00000100:00080000:3.0:1788918651.478545:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.149@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788918651.478552:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.149@tcp: import ffff94ffc8964800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788918651.478597:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffefcb1f80 x1875816865683072/t0(0) o250->MGC192.168.202.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788918651.478741:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865683200:0@lo:400:kworker.0 00000400:00000100:1.0:1788918651.478808:0:3419:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875816865683200 offset 0 length 224: 4 00000100:00100000:2.0:1788918651.479112:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74aa73a2-313d-4992-b461-72ab8c3ab246:3416:1875816865683072:0@lo:250:kworker.0 00000400:00000100:2.0:1788918651.479134:0:3416:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875816865683072 offset 0 length 520: 4 00010000:00010000:0.0:1788918651.479373:0:13503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918651.479386:0:13503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918651.479394:0:13503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918651.479402:0:13503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918651.479429:0:13503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788918651.479437:0:13503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918651.479458:0:13503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918651.479464:0:13503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918651.479472:0:13503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918651.479493:0:13503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788918651.479497:0:13503:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788918651.479527:0:13503:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788918651.479531:0:13503:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788918651.479536:0:13503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788918651.479544:0:13503:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788918651.479560:0:13503:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff94ffe8db8000) has no exports 00000020:00080000:0.0:1788918651.479590:0:13503:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff94ffe8db8000) has no exports 00010000:00010000:1.0:1788918651.482446:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788918651.482461:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918651.482473:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1492a00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918651.482478:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918651.482490:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918651.482498:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918651.482504:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788918651.482506:0:5912:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788918651.482511:0:5912:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788918651.482533:0:5912:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94ffc8964800 00010000:00010000:1.0:1788918651.482537:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918651.482569:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1492a00/0x2811b8b2b0ac8d05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2811b8b2b0ac8d0c expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918651.482589:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918651.482593:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918651.482599:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5c00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918651.482602:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918651.482609:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918651.482616:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918651.482620:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788918651.482622:0:5912:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788918651.482625:0:5912:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788918651.482632:0:5912:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94ffc8964800 00010000:00010000:1.0:1788918651.482636:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918651.482641:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5c00/0x2811b8b2b0ac8f2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2811b8b2b0ac8f35 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918651.482650:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918651.482652:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918651.482659:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788918651.487111:0:13503:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94ffef88bf00 - data ffff94fff8da66c0/ffff94fff68c0c00 00000020:01000000:0.0:1788918651.487274:0:13503:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94ffef88ba20 - data ffff94fff8dee0d8/ffff94ffef80e000 00010000:00010000:2.0:1788918651.489967:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788918651.504765:0:13503:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788918651.519719:0:13503:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8b06 00000020:00000080:0.0:1788918651.519730:0:13503:0:(genops.c:885:class_export_put()) final put ffff94fffcb1c000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788918651.519752:0:13503:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94fffcaac000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788918651.519756:0:13503:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94fffcaac000 2 00000020:01000004:0.0:1788918651.519759:0:13503:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94fffcaac000 from lustre-OST0000 00000020:00000080:0.0:1788918651.519782:0:13503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788918651.519791:0:13503:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788918651.519793:0:13503:0:(genops.c:885:class_export_put()) final put ffff94fffcb1d800/lustre-OST0000_UUID 00000020:00000080:0.0:1788918651.519796:0:13503:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffcb1d800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788918651.519810:0:13503:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788918651.521099:0:13503:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788918651.521109:0:13503:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788918651.521116:0:13503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788918651.521125:0:13503:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788918651.521133:0:13503:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff94fffcb1f800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788918651.521139:0:13503:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff94fffc9b8000) has exports, disconnecting them 00000020:00080000:0.0:1788918651.521144:0:13503:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff94fffcb1f800), last request at 1788918421 00000020:00000080:0.0:1788918651.521149:0:13503:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8b30 00000020:00080000:0.0:1788918651.521165:0:13503:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94fffcb1f800): rc 0 00000020:00000080:0.0:1788918651.521170:0:13503:0:(genops.c:885:class_export_put()) final put ffff94fffcb1f800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788918651.521392:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffcb1c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788918651.521411:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffcb1f800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788918651.527010:0:13503:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788918651.527034:0:13503:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788918651.527039:0:13503:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788918651.527048:0:13503:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788918651.527126:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94fffdbe2000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788918651.527262:0:13503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788918651.527271:0:13503:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788918651.527289:0:13503:0:(genops.c:885:class_export_put()) final put ffff94fffdbe1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788918651.527292:0:13503:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffdbe1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788918651.527304:0:13503:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788918651.527374:0:13503:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94fffcaac000 1 00000020:00000080:2.0:1788918651.527381:0:13503:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8ac0 00000020:00000080:2.0:1788918651.527389:0:13503:0:(genops.c:885:class_export_put()) final put ffff94fffc8e0000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788918651.527409:0:13503:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788918651.527413:0:13503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788918651.527419:0:13503:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788918651.527423:0:13503:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff94fffbdd8000) has no exports 00000020:00000080:0.0:1788918651.527608:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffc8e0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:00010000:2.0:1788918651.548973:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788918651.571756:0:13503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788918651.571776:0:13503:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788918651.571783:0:13503:0:(genops.c:885:class_export_put()) final put ffff94fffcaab800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788918651.571788:0:13503:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffcaab800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788918651.571799:0:13503:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788918651.572074:0:13503:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94fffcaa9800 00000020:02000400:2.0:1788918651.572151:0:13503:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788918652.568843:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918653.594465:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918654.619404:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788918655.367268:0:13705:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788918655.378968:0:13705:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788918655.379092:0:13705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918655.379108:0:13705:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918655.379115:0:13705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918655.379123:0:13705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918655.379148:0:13705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788918655.379153:0:13705:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788918655.379178:0:13705:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788918655.379201:0:13705:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94ffefcb2680 x1875816865682816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918657 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918655.379217:0:13705:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94ffffaf5180 x1875816865682944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918662 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918655.379232:0:13705:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94ffefcb3800 x1875816865683200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918667 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918655.379244:0:13705:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788918655.379251:0:13705:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788918655.379276:0:13705:0:(import.c:65:import_set_state_nolock()) ffff94ffff5fa800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788918655.379333:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865682944:0@lo:400:kworker.0 00000100:00100000:0.0:1788918655.379383:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3419:1875816865683200:0@lo:400:kworker.0 00000100:00100000:2.0:1788918655.379470:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3416:1875816865683328:0@lo:39:umount.0 00000400:00000100:2.0:1788918655.379525:0:3416:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875816865683328 offset 0 length 224: 4 00010000:00010000:3.0:1788918655.381103:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918655.381117:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918655.381130:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4400 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918655.381135:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918655.381147:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918655.381156:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918655.381162:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788918655.381165:0:5912:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788918655.381169:0:5912:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788918655.381188:0:5912:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94ffc8964800 00010000:00010000:3.0:1788918655.381191:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918655.381197:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffefbf4400/0x2811b8b2b0ac8cdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2811b8b2b0ac8ce2 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918655.381210:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918655.381212:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918655.381214:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918655.381258:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865682816:0@lo:400:kworker.0 00010000:00010000:2.0:1788918655.638495:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788918656.598420:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 74aa73a2-313d-4992-b461-72ab8c3ab246->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788918656.598428:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 74aa73a2-313d-4992-b461-72ab8c3ab246->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788918656.664334:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918657.688070:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918658.711766:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918659.737738:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918660.759880:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788918661.718349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 74aa73a2-313d-4992-b461-72ab8c3ab246->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788918661.718362:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 74aa73a2-313d-4992-b461-72ab8c3ab246->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788918661.782329:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918662.807013:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918663.831514:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918664.854979:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918665.623083:0:3416:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788918655/real 1788918655] req@ffff94ffffaf4700 x1875816865683328/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788918665 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918665.623477:0:3416:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94ffffaf4700 x1875816865683328/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788918665 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788918665.623497:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94ffff5fa800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788918665.623786:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3416:1875816865683328:0@lo:39:umount.0 00000100:00080000:0.0:1788918665.623878:0:13705:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788918665.623884:0:13705:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788918665.623890:0:13705:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788918665.624870:0:13705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918665.624884:0:13705:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918665.624891:0:13705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918665.624897:0:13705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918665.624937:0:13705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788918665.624945:0:13705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918665.624961:0:13705:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918665.624967:0:13705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918665.624972:0:13705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918665.624992:0:13705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788918665.624997:0:13705:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788918665.625064:0:13705:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788918665.625069:0:13705:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788918665.625074:0:13705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788918665.625079:0:13705:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788918665.625084:0:13705:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff94fff6b8cd40) has no exports 00000020:00080000:0.0:1788918665.625108:0:13705:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff94fff6b8cd40) has no exports 00010000:00010000:3.0:1788918665.625718:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788918665.625727:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918665.625735:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc1492000 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918665.625738:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918665.625747:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918665.625755:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918665.625760:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788918665.625762:0:5912:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788918665.625764:0:5912:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788918665.625778:0:5912:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94ffc8964800 00010000:00010000:3.0:1788918665.625781:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918665.625787:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1492000/0x2811b8b2b0ac8ce9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2811b8b2b0ac8cf0 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918665.625808:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918665.625811:0:5912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918665.625816:0:5912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5000 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:3.0:1788918665.625819:0:5912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918665.625824:0:5912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918665.625829:0:5912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918665.625833:0:5912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788918665.625835:0:5912:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788918665.625836:0:5912:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788918665.625839:0:5912:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94ffc8964800 00010000:00010000:3.0:1788918665.625842:0:5912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918665.625847:0:5912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5000/0x2811b8b2b0ac8f20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2811b8b2b0ac8f27 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918665.625857:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918665.625858:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918665.625860:0:5912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918665.628407:0:5913:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788918665.641405:0:13705:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94ffef88b8a0 - data ffff94fff8dabbd0/ffff94fff68c2400 00000020:01000000:1.0:1788918665.641572:0:13705:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94fff4873ba0 - data ffff94fff8c4c948/ffff94fffdba7c00 00100000:10000000:2.0:1788918665.655413:0:13705:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788918665.664629:0:13705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8bd1 00000020:00000080:3.0:1788918665.664644:0:13705:0:(genops.c:885:class_export_put()) final put ffff94fffdbe7000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788918665.664669:0:13705:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94ffef803800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788918665.664673:0:13705:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94ffef803800 2 00000020:01000004:3.0:1788918665.664677:0:13705:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94ffef803800 from lustre-OST0001 00000020:00000080:3.0:1788918665.664709:0:13705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788918665.664721:0:13705:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788918665.664725:0:13705:0:(genops.c:885:class_export_put()) final put ffff94fffdbe4800/lustre-OST0001_UUID 00000020:00000080:3.0:1788918665.664729:0:13705:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffdbe4800/lustre-OST0001_UUID for lustre-OST0001 00000020:00000080:0.0:1788918665.664730:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffdbe7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788918665.664736:0:13705:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788918665.664840:0:13705:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 74aa73a2-313d-4992-b461-72ab8c3ab246->MGS 00010000:00010000:3.0:1788918665.664857:0:13705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc1493200/0x2811b8b2b0ac8ae3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2811b8b2b0ac8aea expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918665.664870:0:13705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc1493200/0x2811b8b2b0ac8ae3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2811b8b2b0ac8aea expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918665.664876:0:13705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788918665.664879:0:13705:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788918665.664883:0:13705:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788918665.664897:0:13705:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94ffc8964800 00010000:00010000:3.0:1788918665.664901:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc1493200/0x2811b8b2b0ac8ae3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2811b8b2b0ac8aea expref: -99 pid: 6903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918665.664918:0:13705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0ac8d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2811b8b2b0ac8d36 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788918665.664926:0:13705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0ac8d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2811b8b2b0ac8d36 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918665.664931:0:13705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788918665.664933:0:13705:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788918665.664935:0:13705:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788918665.664943:0:13705:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94ffc8964800 00010000:00010000:3.0:1788918665.664964:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0ac8d2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2811b8b2b0ac8d36 expref: -99 pid: 5921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788918665.664982:0:13705:0:(import.c:65:import_set_state_nolock()) ffff94ffc8964800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788918665.664986:0:13705:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788918665.664989:0:13705:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788918665.664990:0:13705:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788918665.664995:0:13705:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788918665.665007:0:13705:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94ffefcb1f80 x1875816865683072/t0(0) o250->MGC192.168.202.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788918666 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788918665.665048:0:13705:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788918665.665051:0:13705:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:0.0:1788918665.666541:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74aa73a2-313d-4992-b461-72ab8c3ab246:3416:1875816865683072:0@lo:250:kworker.0 10000000:01000000:3.0:1788918665.667546:0:13705:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788918665.667565:0:13705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac89c4 00000020:00000080:3.0:1788918665.667574:0:13705:0:(genops.c:885:class_export_put()) final put ffff94ffc8961800/74aa73a2-313d-4992-b461-72ab8c3ab246 00000020:01000000:3.0:1788918665.667595:0:13705:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.149@tcp (flags='') 00000020:00000080:3.0:1788918665.667604:0:13705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788918665.667612:0:13705:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.149@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788918665.667616:0:13705:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff94fffbddcd40) has no exports 10000000:01000000:1.0:1788918665.667679:0:5921:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1788918665.667708:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffc8961800/74aa73a2-313d-4992-b461-72ab8c3ab246 for MGC192.168.202.149@tcp 10000000:01000000:3.0:1788918665.667782:0:13705:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.149@tcp: client import never connected 00000100:00080000:3.0:1788918665.667787:0:13705:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788918665.667800:0:13705:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788918665.667804:0:13705:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788918665.667806:0:13705:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788918665.667869:0:13705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788918665.667875:0:13705:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.149@tcp (uuid 74aa73a2-313d-4992-b461-72ab8c3ab246) 00000020:01000000:3.0:1788918665.667881:0:13705:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788918665.667884:0:13705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788918665.667888:0:13705:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788918665.667895:0:13705:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff94ffff5ff000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788918665.667900:0:13705:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff94fffca38000) has exports, disconnecting them 00000020:00080000:3.0:1788918665.667904:0:13705:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff94ffff5ff000), last request at 1788918441 00000020:00000080:3.0:1788918665.667919:0:13705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8bfb 00000020:00080000:3.0:1788918665.667930:0:13705:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94ffff5ff000): rc 0 00000020:00000080:3.0:1788918665.667934:0:13705:0:(genops.c:885:class_export_put()) final put ffff94ffff5ff000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788918665.667982:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffc8964800 for MGC192.168.202.149@tcp 00000020:00000080:0.0:1788918665.667991:0:36:0:(genops.c:885:class_export_put()) final put ffff94ffc8963800/74aa73a2-313d-4992-b461-72ab8c3ab246 00000020:00000080:0.0:1788918665.667993:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffc8963800/74aa73a2-313d-4992-b461-72ab8c3ab246 for MGC192.168.202.149@tcp 00000020:01000000:0.0:1788918665.668007:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.149@tcp (74aa73a2-313d-4992-b461-72ab8c3ab246) 00000020:00000080:0.0:1788918665.669633:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffff5ff000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788918665.671569:0:13705:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788918665.671579:0:13705:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788918665.671583:0:13705:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788918665.671591:0:13705:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788918665.671672:0:5912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788918665.671790:0:5913:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1788918665.671885:0:5908:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff94ffc92dee00:5908] 1 exiting: rc = 0 00000020:00000080:0.0:1788918665.671943:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94ffff5fa800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:1.0:1788918665.671945:0:5907:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff94ffc92df600:5907] 0 exiting: rc = 1 00000100:00100000:0.0:1788918665.672000:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.672483:0:5911:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff94ffc92dfa00:5911] 2 exiting: rc = 0 00000100:00100000:1.0:1788918665.672570:0:8796:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff94ffefac5800:8796] 4 exiting: rc = 0 00000100:00100000:1.0:1788918665.672641:0:5910:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff94ffc92de600:5910] 1 exiting: rc = 0 00000100:00100000:1.0:1788918665.672725:0:7989:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff94fff6b26000:7989] 3 exiting: rc = 0 00000100:00100000:0.0:1788918665.673679:0:5909:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff94ffc92dfe00:5909] 0 exiting: rc = 1 00000100:00100000:1.0:1788918665.674415:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674428:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674435:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674441:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674449:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674456:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674463:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674470:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674476:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674482:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674488:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674494:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674499:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674504:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674510:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674516:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674524:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674530:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674535:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674540:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674546:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674552:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674558:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674583:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674590:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674596:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674602:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674608:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674613:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674619:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674624:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674629:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674635:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674640:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674646:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674651:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674657:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674662:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674668:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674673:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674679:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674684:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674689:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674695:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674700:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674705:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674711:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674716:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674721:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674727:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674732:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674737:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674743:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674748:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674753:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674758:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674763:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674768:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674784:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674789:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674794:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674799:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674804:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788918665.674809:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788918665.678314:0:13705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788918665.678326:0:13705:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788918665.678332:0:13705:0:(genops.c:885:class_export_put()) final put ffff94fffdaff800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788918665.678337:0:13705:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffdaff800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788918665.678344:0:13705:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788918665.678405:0:13705:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94ffef803800 1 00000020:00000080:1.0:1788918665.678411:0:13705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2811b8b2b0ac8ba0 00000020:00000080:1.0:1788918665.678416:0:13705:0:(genops.c:885:class_export_put()) final put ffff94ffd043c800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788918665.678426:0:13705:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788918665.678429:0:13705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788918665.678433:0:13705:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788918665.678436:0:13705:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff94fffca399c0) has no exports 00000020:00000080:0.0:1788918665.679423:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffd043c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788918665.939007:0:13705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788918665.939039:0:13705:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788918665.939046:0:13705:0:(genops.c:885:class_export_put()) final put ffff94ffef807800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788918665.939051:0:13705:0:(genops.c:844:class_export_destroy()) destroying export ffff94ffef807800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788918665.939059:0:13705:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788918665.939339:0:13705:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94ffef807000 00000020:01000000:0.0:1788918665.939363:0:13705:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788918665.939368:0:13705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788918665.939374:0:13705:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788918665.939378:0:13705:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff94fffc9b99c0) has no exports 00000020:00000080:0.0:1788918665.939409:0:13705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788918665.940212:0:13705:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788918665.940221:0:13705:0:(genops.c:885:class_export_put()) final put ffff94fffc8e2800/OSS_uuid 00000020:00000080:0.0:1788918665.940226:0:13705:0:(genops.c:844:class_export_destroy()) destroying export ffff94fffc8e2800/OSS_uuid for OSS 00000020:01000000:0.0:1788918665.940232:0:13705:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788918665.940279:0:5920:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788918665.941921:0:6909:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff94ffd0830000:6909] 0 exiting: rc = 1 00000100:00100000:3.0:1788918665.941930:0:6912:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff94ffd8011400:6912] 2 exiting: rc = 0 00000100:00100000:0.0:1788918665.942306:0:7258:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff94fff4ad0400:7258] 3 exiting: rc = 0 00000100:00100000:0.0:1788918665.943695:0:6911:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff94fff48cc400:6911] 1 exiting: rc = 0 00000100:00100000:0.0:1788918665.943793:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943802:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943809:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943816:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943822:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943828:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943833:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943838:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943843:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943849:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943854:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943860:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943865:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943870:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943875:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943880:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943885:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943890:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943895:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943900:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943906:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943911:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943916:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943921:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943925:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943931:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943936:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943942:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943959:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943965:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943971:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943976:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943981:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.943987:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944008:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944014:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944035:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944042:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944046:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944051:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944056:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944062:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944066:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944071:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944076:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944081:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944086:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944092:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944097:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944102:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944108:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944112:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944117:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944123:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944129:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944134:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944140:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944146:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944151:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944156:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944161:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944167:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944172:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.944185:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788918665.946301:0:6913:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff94ffd8010000:6913] 0 exiting: rc = 1 00000100:00100000:3.0:1788918665.946619:0:6914:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff94ffd81dda00:6914] 1 exiting: rc = 0 00000100:00100000:0.0:1788918665.946961:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.946972:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.946977:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.946983:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.946988:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947008:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947014:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947039:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947045:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947050:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947056:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947063:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947069:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947074:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947080:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947085:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947090:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947095:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947099:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947105:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947109:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947114:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947120:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947125:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947129:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947134:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947140:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947145:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947150:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947154:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947159:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947164:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947170:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947176:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947181:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947186:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947191:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947195:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947200:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947206:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947220:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947226:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947232:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947237:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947243:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947249:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947253:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947258:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947265:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947271:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947277:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947287:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947294:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947299:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947304:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947309:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947314:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947319:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947324:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947329:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947334:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947339:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947343:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.947349:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.949638:0:6915:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff94fffca7a400:6915] 0 exiting: rc = 1 00000100:00100000:3.0:1788918665.949701:0:6916:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff94fffca7ae00:6916] 1 exiting: rc = 0 00000100:00100000:3.0:1788918665.950615:0:6917:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff94fffca7a200:6917] 2 exiting: rc = 0 00000100:00100000:0.0:1788918665.951618:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951627:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951634:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951640:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951646:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951651:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951657:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951663:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951668:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951674:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951690:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951696:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951702:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951707:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951712:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951717:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951723:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951729:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951735:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951740:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951746:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951751:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951757:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951763:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951768:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951773:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951795:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951802:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951807:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951812:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951818:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951823:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951828:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951834:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951840:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951845:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951850:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951855:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951861:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951866:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951872:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951878:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951883:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951889:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951894:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951907:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951912:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951918:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951924:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951929:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951958:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951967:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951972:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951977:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951983:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951988:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951994:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.951999:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.952004:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.952009:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.952014:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.952036:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.952042:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.952047:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.961213:0:6919:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff94fff484de00:6919] 1 exiting: rc = 0 00000100:00100000:3.0:1788918665.961913:0:6918:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff94fff484ce00:6918] 0 exiting: rc = 1 00000100:00100000:0.0:1788918665.962429:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962437:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962443:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962448:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962453:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962459:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962464:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962470:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962475:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962480:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962486:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962492:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962510:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962519:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962527:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962547:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962552:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962557:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962563:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962569:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962574:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962579:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962585:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962591:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962596:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962621:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962628:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962634:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962639:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962644:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962650:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962655:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962661:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962666:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962671:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962676:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962682:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962687:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962693:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962698:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962703:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962708:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962714:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962719:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962725:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962730:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962735:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962740:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962745:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962750:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962762:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962767:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962772:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962777:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962782:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962788:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962793:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962798:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962803:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962808:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962814:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962819:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962824:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.962829:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.963672:0:6921:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff94fff4ad1600:6921] 1 exiting: rc = 0 00000100:00100000:3.0:1788918665.963905:0:6920:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff94fff4ad0a00:6920] 0 exiting: rc = 1 00000100:00100000:0.0:1788918665.964071:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964091:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964099:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964106:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964113:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964122:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964144:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964154:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964160:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964167:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964175:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964181:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964187:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964194:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964201:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964207:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964212:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964218:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964239:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964247:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964262:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964269:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964275:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964280:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964285:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964290:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964295:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964301:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964307:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964312:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964332:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964339:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964345:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964351:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964358:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964365:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964370:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964375:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964382:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964388:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964393:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964398:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964556:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964567:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964574:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964582:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964592:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964599:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964605:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964611:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964618:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964623:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964630:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964636:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964658:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964671:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964677:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964683:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964688:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964694:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964701:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964707:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964714:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788918665.964730:0:13705:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788918665.982725:0:13705:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788918684.797567:0:14367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788918697.486870:0:14969:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788918697.486945:0:14969:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788918697.486947:0:14969:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788918697.487318:0:14969:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94fffcaab000 00000020:01000004:0.0:1788918697.487333:0:14969:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788918697.487340:0:14969:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788918697.487354:0:14969:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff94ffe8db8000) 00000020:00000080:0.0:1788918697.487366:0:14969:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788918697.572950:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788918697.573916:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788918697.575254:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788918697.575475:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788918697.576045:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788918697.576331:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788918697.576616:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788918697.576870:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788918697.577555:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788918697.578369:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788918697.578619:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788918697.579342:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788918697.579684:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788918697.580578:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788918697.588800:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788918697.589340:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788918697.590308:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788918697.590640:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788918697.590866:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788918697.591596:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788918697.594826:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788918697.595667:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788918697.595970:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788918697.596290:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788918697.596538:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788918697.596796:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788918697.597148:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788918697.597468:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788918697.597736:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788918697.597963:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788918697.598369:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788918697.598687:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788918697.598864:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788918697.601990:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788918697.603256:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788918697.603936:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788918697.604358:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788918697.604950:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788918697.607985:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788918697.611900:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788918697.612747:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788918697.613099:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788918697.613386:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788918697.615256:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788918697.615639:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788918697.616722:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788918697.621771:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788918697.626541:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788918697.629817:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788918697.640162:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788918697.646074:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788918697.646675:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788918697.646970:0:14969:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788918697.648338:0:14969:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788918697.648795:0:14969:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788918697.648805:0:14969:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788918697.648818:0:14969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac9d20 00000020:01000004:3.0:1788918697.648826:0:14969:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788918697.648830:0:14969:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788918697.648835:0:14969:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94fffcaab000 from MGS 00000020:01000004:3.0:1788918697.648839:0:14969:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788918697.648849:0:14969:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff94fff6b8cd40) 00000020:00000080:3.0:1788918697.648860:0:14969:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788918697.648925:0:14969:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94fffcaab000 from MGS, refs=2 00080000:01000000:3.0:1788918697.648931:0:14969:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788918697.648935:0:14969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac9d2e 00000100:00100000:2.0:1788918697.650067:0:14969:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788918697.650403:0:14969:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788918697.650410:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788918697.656777:0:14969:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788918697.656791:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788918697.658388:0:14969:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788918697.658911:0:14969:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788918697.658918:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788918697.661847:0:14969:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788918697.661862:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788918697.667692:0:14969:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788918697.667711:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788918697.669349:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918697.669355:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918697.669357:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918697.675704:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918697.675710:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918697.675713:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918697.676347:0:14969:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788918697.684704:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788918697.695350:0:14969:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788918697.699534:0:14981:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788918697.699712:0:14969:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788918697.699776:0:14969:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788918697.702938:0:14969:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788918697.703314:0:14969:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918697.703527:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788918697.703536:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788918697.707346:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788918697.707365:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788918697.718473:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788918697.718488:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788918697.719902:0:14969:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788918697.719926:0:14969:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.149@tcp' 00000020:01000004:0.0:1788918697.719928:0:14969:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788918697.719961:0:14969:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.149@tcp (typ=mgc) 00000020:00000080:0.0:1788918697.719974:0:14969:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.149@tcp (ffff94ffe8dbcd40) 00000020:00000080:0.0:1788918697.719991:0:14969:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788918697.720125:0:14969:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94fffc8e2800@MGC192.168.202.149@tcp: add connection 192.168.202.149@tcp at head 00010000:00010000:0.0:1788918697.720302:0:14969:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.149@tcp-0 is initialized 00000040:01000000:0.0:1788918697.720309:0:14969:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788918697.720764:0:14986:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788918697.728955:0:14987:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788918697.729058:0:14969:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.149@tcp (uuid 05d27ece-a3bf-4c95-8d2a-88ac445b15ff) 00000020:00000080:1.0:1788918697.729089:0:14969:0:(genops.c:1385:class_connect()) connect: client 05d27ece-a3bf-4c95-8d2a-88ac445b15ff, cookie 0x2811b8b2b0ac9d3c 00000100:00080000:1.0:1788918697.729104:0:14969:0:(import.c:545:import_select_connection()) MGC192.168.202.149@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788918697.729111:0:14969:0:(import.c:665:import_select_connection()) MGC192.168.202.149@tcp: import ffff94fffc8e2800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:1.0:1788918697.729161:0:14969:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffff844000 x1875816865683456/t0(0) o250->MGC192.168.202.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788918697.729188:0:14969:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 05d27ece-a3bf-4c95-8d2a-88ac445b15ff->MGS 00000020:01000004:1.0:1788918697.729214:0:14969:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788918697.729219:0:14969:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788918697.729235:0:14969:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff94fffc9b99c0) 00000020:00000080:1.0:1788918697.729247:0:14969:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788918697.730799:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3416:1875816865683456:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788918697.730895:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918697.744964:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865683456 00000100:00100000:2.0:1788918697.744979:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865683456 00000100:00100000:2.0:1788918697.745052:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788918697.745062:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3416:x1875816865683456:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788918697.745095:0:14982:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 05d27ece-a3bf-4c95-8d2a-88ac445b15ff@0@lo t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:2.0:1788918697.745126:0:14982:0:(genops.c:1385:class_connect()) connect: client 05d27ece-a3bf-4c95-8d2a-88ac445b15ff, cookie 0x2811b8b2b0ac9d4a 00000100:00080000:2.0:1788918697.746435:0:14982:0:(import.c:65:import_set_state_nolock()) ffff94ffff87f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788918697.749989:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+5:3416:x1875816865683456:12345-0@lo:250:mount.lustre.0 Request processed in 4912us (19078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918697.750007:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788918697.750089:0:3416:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.149@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788918697.750100:0:3416:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.149@tcp: connect to target with instance 0 00000100:00080000:2.0:1788918697.750109:0:3416:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.149@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788918697.750115:0:3416:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788918697.750119:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94fffc8e2800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788918697.750121:0:3416:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788918697.750135:0:3416:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788918697.750142:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3416:1875816865683456:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788918697.767581:0:14969:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788918697.768293:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788918697.768300:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788918697.769369:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788918697.769386:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788918697.769938:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788918697.769945:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788918697.771444:0:14969:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788918697.771790:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788918697.771797:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788918697.787596:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788918697.796326:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788918697.868689:0:14969:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788918697.868914:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788918697.868922:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788918697.878381:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788918697.878398:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788918697.879063:0:14969:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918697.879253:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788918697.879258:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788918697.903333:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788918697.903356:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788918697.905706:0:14969:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918697.905898:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788918697.905904:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788918697.906787:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788918697.906798:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788918697.909124:0:14969:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918697.909448:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788918697.909469:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788918697.917398:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788918697.917414:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788918697.977377:0:14969:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788918697.978105:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788918697.978114:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788918697.983073:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788918697.983100:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788918697.984311:0:14969:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788918697.984322:0:14969:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788918697.985470:0:14969:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788918697.985578:0:14969:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788918697.985586:0:14969:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.149@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788918697.985712:0:14969:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788918697.985749:0:14969:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.149@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788918697.985754:0:14969:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788918697.985756:0:14969:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788918697.985757:0:14969:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788918697.985759:0:14969:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788918697.985760:0:14969:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788918697.985766:0:14969:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788918697.985768:0:14969:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788918697.985769:0:14969:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788918697.985771:0:14969:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788918697.985772:0:14969:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788918697.985775:0:14969:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788918697.985777:0:14969:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788918697.985778:0:14969:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788918697.985779:0:14969:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788918697.985780:0:14969:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788918697.985780:0:14969:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788918697.985781:0:14969:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788918697.985782:0:14969:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788918697.985783:0:14969:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788918697.985784:0:14969:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788918697.985785:0:14969:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788918697.985818:0:14969:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788918697.985843:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865683584:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788918697.985915:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918697.985966:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd81a3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788918697.986179:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865683584 00000100:00100000:0.0:1788918697.986188:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865683584 00000100:00100000:0.0:1788918697.986306:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788918697.986316:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+5:14969:x1875816865683584:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788918697.986365:0:14985:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788918697.986368:0:14985:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788918697.986371:0:14985:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788918697.987144:0:15006:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788918697.988324:0:14985:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788918697.992961:0:15007:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788918697.992972:0:15007:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788918697.992975:0:15007:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788918697.992985:0:15007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788918697.993266:0:14985:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788918697.993279:0:14985:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788918697.996529:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+5:14969:x1875816865683584:12345-0@lo:253:mount.lustre.0 Request processed in 10203us (10602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918697.996547:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788918697.996883:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865683584:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788918697.996901:0:14969:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788918697.996904:0:14969:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788918697.996906:0:14969:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788918697.996907:0:14969:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788918697.996909:0:14969:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788918697.996910:0:14969:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788918697.996911:0:14969:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788918697.996913:0:14969:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788918697.996914:0:14969:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788918697.996916:0:14969:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788918697.996918:0:14969:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788918697.996943:0:14969:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94fffcaab000 from lustre-MDT0000 10000000:01000000:2.0:1788918697.996979:0:14969:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788918697.996982:0:14969:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788918697.996987:0:14969:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff94ffe8dbcd40 10000000:01000000:2.0:1788918697.997003:0:14969:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788918697.997014:0:14969:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94ffe8dbcd40 from 1 10000000:01000000:2.0:1788918697.997295:0:14969:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788918697.997339:0:14969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dc600/0x2811b8b2b0ac9d51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918697.997350:0:14969:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fff48dc600/0x2811b8b2b0ac9d51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918697.997360:0:14969:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fff48dc600/0x2811b8b2b0ac9d51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918697.997380:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865683712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788918697.997426:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918697.997533:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd81a3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788918698.004791:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865683712 00000100:00100000:0.0:1788918698.004811:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865683712 00000100:00100000:0.0:1788918698.004889:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788918698.004903:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+5:14969:x1875816865683712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788918698.004940:0:14983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918698.004970:0:14983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcb20800/0x2811b8b2b0ac9d58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9d51 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.005000:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcb20800/0x2811b8b2b0ac9d58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9d51 expref: 6 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.005013:0:14983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcb20800/0x2811b8b2b0ac9d58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9d51 expref: 6 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.005039:0:14983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20800, rc 0) 00000100:00100000:0.0:1788918698.005140:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+6:14969:x1875816865683712:12345-0@lo:101:mount.lustre.0 Request processed in 240us (7712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918698.005147:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788918698.005407:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865683712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788918698.005427:0:14969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fff48dc600/0x2811b8b2b0ac9d51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d58 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.005438:0:14969:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fff48dc600/0x2811b8b2b0ac9d51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9d58 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918698.005685:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865683840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788918698.005726:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918698.005758:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918698.005827:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865683840 00000100:00100000:0.0:1788918698.005832:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865683840 00000100:00100000:0.0:1788918698.005868:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788918698.005875:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+6:14969:x1875816865683840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788918698.006068:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+6:14969:x1875816865683840:12345-0@lo:501:mount.lustre.0 Request processed in 192us (341us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788918698.006075:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788918698.015821:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865683840:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788918698.015887:0:14969:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788918698.015986:0:14969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dc600/0x2811b8b2b0ac9d51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d58 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.015998:0:14969:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fff48dc600/0x2811b8b2b0ac9d51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d58 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918698.016008:0:14969:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94fffcaab000 10000000:01000000:2.0:1788918698.016017:0:14969:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788918698.016040:0:14969:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94fffcaab000 10000000:01000000:2.0:1788918698.016043:0:14969:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788918698.016047:0:14969:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff94fffcaab000 from 1 10000000:01000000:2.0:1788918698.016050:0:14969:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788918698.016111:0:14969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dcc00/0x2811b8b2b0ac9d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.016120:0:14969:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fff48dcc00/0x2811b8b2b0ac9d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.016132:0:14969:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fff48dcc00/0x2811b8b2b0ac9d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918698.016154:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865683968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788918698.016343:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918698.016395:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd81a3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788918698.016478:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865683968 00000100:00100000:0.0:1788918698.016486:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865683968 00000100:00100000:0.0:1788918698.016556:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788918698.016566:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+6:14969:x1875816865683968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788918698.016580:0:14982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918698.016594:0:14982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcb21c00/0x2811b8b2b0ac9d66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9d5f expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.016632:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcb21c00/0x2811b8b2b0ac9d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9d5f expref: 7 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.016643:0:14982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcb21c00/0x2811b8b2b0ac9d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9d5f expref: 7 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.016661:0:14982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21c00, rc 0) 00000100:00100000:0.0:1788918698.016701:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+7:14969:x1875816865683968:12345-0@lo:101:mount.lustre.0 Request processed in 137us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918698.016708:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788918698.016868:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865683968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788918698.016882:0:14969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fff48dcc00/0x2811b8b2b0ac9d5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d66 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.016890:0:14969:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fff48dcc00/0x2811b8b2b0ac9d5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9d66 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918698.016903:0:14969:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788918698.019365:0:14969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dcc00/0x2811b8b2b0ac9d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d66 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.019384:0:14969:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fff48dcc00/0x2811b8b2b0ac9d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d66 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918698.019393:0:14969:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788918698.019403:0:14969:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788918698.019411:0:14969:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94fffcaab000 10000000:01000000:2.0:1788918698.019427:0:14969:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788918698.019431:0:14969:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788918698.019434:0:14969:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788918698.019483:0:14969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac9d6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.019491:0:14969:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac9d6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.019512:0:14969:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac9d6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918698.019538:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865684096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788918698.019618:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918698.019672:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd81a3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788918698.019794:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865684096 00000100:00100000:0.0:1788918698.019802:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865684096 00000100:00100000:0.0:1788918698.019857:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788918698.019866:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc395e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+7:14969:x1875816865684096:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788918698.019877:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918698.019889:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcb21800/0x2811b8b2b0ac9d74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9d6d expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.019913:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcb21800/0x2811b8b2b0ac9d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9d6d expref: 8 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.019925:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcb21800/0x2811b8b2b0ac9d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9d6d expref: 8 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.019934:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21800, rc 0) 00000100:00100000:0.0:1788918698.019986:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc395e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+8:14969:x1875816865684096:12345-0@lo:101:mount.lustre.0 Request processed in 121us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918698.019993:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788918698.020139:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865684096:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788918698.020155:0:14969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac9d6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d74 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918698.020164:0:14969:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac9d6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9d74 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918698.020238:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865684224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788918698.020269:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918698.020292:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2afd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918698.020411:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865684224 00000100:00100000:0.0:1788918698.020416:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865684224 00000100:00100000:0.0:1788918698.020449:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788918698.020457:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc395c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+8:14969:x1875816865684224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788918698.020603:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc395c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+9:14969:x1875816865684224:12345-0@lo:501:mount.lustre.0 Request processed in 146us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918698.020610:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788918698.022505:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865684224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788918698.022583:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865684352:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788918698.022684:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918698.022723:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2afd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918698.023341:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865684352 00000100:00100000:0.0:1788918698.023349:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865684352 00000100:00100000:0.0:1788918698.023409:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788918698.023420:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe08bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+9:14969:x1875816865684352:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788918698.025112:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe08bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+9:14969:x1875816865684352:12345-0@lo:503:mount.lustre.0 Request processed in 1685us (2419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918698.025126:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788918698.025390:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865684352:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788918698.026124:0:15008:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15008:1875816865684480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918698.026188:0:15008:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918698.026226:0:15008:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2af9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918698.026323:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865684480 00000100:00100000:0.0:1788918698.026331:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865684480 00000100:00100000:0.0:1788918698.026384:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788918698.026397:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe08bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+9:15008:x1875816865684480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918698.027476:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe08bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+9:15008:x1875816865684480:12345-0@lo:502:llog_process_th.0 Request processed in 1077us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918698.027485:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788918698.027757:0:15008:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15008:1875816865684480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788918698.027793:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788918698.027805:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918698.027808:0:15008:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788918698.027815:0:15008:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788918698.027818:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788918698.027835:0:15008:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff94fffc9b8000) 00000020:00000080:1.0:1788918698.027853:0:15008:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788918698.027859:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788918698.027938:0:15008:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788918698.027945:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac9d82 00000020:00000080:1.0:1788918698.028257:0:15008:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788918698.028262:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788918698.028272:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918698.028274:0:15008:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788918698.028278:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788918698.028282:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918698.028283:0:15008:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788918698.028287:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788918698.028295:0:15008:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff94fffc9bb380) 00000020:00000080:1.0:1788918698.028305:0:15008:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788918698.028310:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788918698.028312:0:15008:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788918698.028316:0:15008:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788918698.028323:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788918698.028364:0:15008:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94fffcaab000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788918698.028376:0:15008:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff94fffc9bcd40) 00000020:00000080:1.0:1788918698.028385:0:15008:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788918698.028432:0:15008:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788918698.028437:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2811b8b2b0ac9d97 00000020:00000080:1.0:1788918698.028873:0:15008:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788918698.028880:0:15008:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788918698.028885:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2811b8b2b0ac9d9e 00080000:01000000:1.0:1788918698.028891:0:15008:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788918698.028894:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac9da5 00010000:00010000:3.0:1788918698.187676:0:15008:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788918698.190813:0:15008:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788918698.192389:0:15008:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788918698.192973:0:15008:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff94fff6b8b380) 00000020:00000080:3.0:1788918698.192997:0:15008:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788918698.193122:0:15008:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788918698.193130:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac9db3 00000020:00000080:3.0:1788918698.214737:0:15008:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788918698.224264:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2811b8b2b0ac9dba 00000020:00000080:2.0:1788918698.224919:0:15008:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788918698.224933:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918698.224940:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918698.224943:0:15008:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788918698.224945:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788918698.224948:0:15008:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788918698.224950:0:15008:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788918698.224951:0:15008:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788918698.224953:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788918698.224955:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918698.224956:0:15008:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788918698.224958:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918698.224964:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918698.224965:0:15008:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788918698.224969:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788918698.225230:0:15008:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788918698.225250:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918698.225259:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918698.225261:0:15008:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788918698.225264:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788918698.225268:0:15008:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788918698.225272:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918698.225273:0:15008:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788918698.225277:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788918698.225282:0:15008:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.149@tcp to nid 0x20000c0a8ca95 (192.168.202.149@tcp) 00000020:01000000:2.0:1788918698.225313:0:15008:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788918698.225316:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788918698.225336:0:15008:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff94fffca3cd40) 00000020:00000080:2.0:1788918698.225353:0:15008:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788918698.225358:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788918698.225429:0:15008:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788918698.225435:0:15008:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788918698.225443:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac9dc8 00010000:00080000:0.0:1788918698.226015:0:15008:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94fffc8e7000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.149@tcp at head 00010000:00010000:0.0:1788918698.226295:0:15008:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788918698.230794:0:15008:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788918698.231483:0:15008:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788918698.245886:0:15008:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788918698.247000:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788918698.259149:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788918698.259795:0:15012:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788918698.259801:0:15012:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788918698.260648:0:15008:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788918698.260674:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788918698.260725:0:15008:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788918698.260746:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2811b8b2b0ac9dcf 00000100:00080000:3.0:1788918698.260757:0:15008:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788918698.260765:0:15008:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94fffc8e7000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788918698.260801:0:15008:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffefcb0380 x1875816865684608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788918698.260831:0:15008:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788918698.260898:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918698.260908:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918698.260910:0:15008:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788918698.260914:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788918698.260916:0:15008:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788918698.260918:0:15008:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788918698.260919:0:15008:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788918698.260920:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788918698.260923:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918698.260924:0:15008:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788918698.260927:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788918698.260932:0:15008:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788918698.260935:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918698.260937:0:15008:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788918698.260939:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788918698.260943:0:15008:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.149@tcp to nid 0x20000c0a8ca95 (192.168.202.149@tcp) 00000020:01000000:3.0:1788918698.260967:0:15008:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788918698.260970:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788918698.260981:0:15008:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff94fff6b899c0) 00000020:00000080:3.0:1788918698.260993:0:15008:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788918698.260998:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788918698.261092:0:15008:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788918698.261098:0:15008:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788918698.261103:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2811b8b2b0ac9ddd 00010000:00080000:3.0:1788918698.261140:0:15008:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94ffd0565800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.149@tcp at head 00010000:00010000:3.0:1788918698.261332:0:15008:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788918698.261399:0:15008:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788918698.261416:0:15008:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788918698.262062:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865684608:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788918698.262124:0:3416:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875816865684608 offset 0 length 520: 4 00000040:00080000:2.0:1788918698.270440:0:15008:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788918698.271173:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788918698.271342:0:15008:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788918698.272274:0:15014:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788918698.272280:0:15014:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788918698.273069:0:15008:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788918698.273082:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788918698.273126:0:15008:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788918698.273151:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2811b8b2b0ac9de4 00000100:00080000:2.0:1788918698.273162:0:15008:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788918698.273169:0:15008:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94ffd0565800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788918698.273212:0:15008:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffffa8bb80 x1875816865684736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788918698.273243:0:15008:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788918698.273300:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918698.273304:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918698.273306:0:15008:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788918698.273309:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918698.273312:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918698.273314:0:15008:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788918698.273316:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788918698.273318:0:15008:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788918698.273320:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918698.273322:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918698.273324:0:15008:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788918698.273326:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918698.273328:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918698.273329:0:15008:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788918698.273332:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788918698.273362:0:15008:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15008:1875816865684864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788918698.273440:0:15008:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918698.273740:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865684736:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788918698.273773:0:3416:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875816865684736 offset 0 length 520: 4 00000100:00100000:0.0:1788918698.273808:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865684864 00000100:00100000:0.0:1788918698.273814:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865684864 00000100:00100000:0.0:1788918698.273865:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788918698.273874:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff742c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+9:15008:x1875816865684864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918698.273994:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff742c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+9:15008:x1875816865684864:12345-0@lo:502:llog_process_th.0 Request processed in 121us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918698.274002:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788918698.274322:0:15008:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99840 going to sleep for 11 seconds 00000100:00100000:2.0:1788918698.274350:0:15008:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15008:1875816865684864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788918698.274380:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918698.274385:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918698.274387:0:15008:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788918698.274391:0:15008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788918698.276325:0:14969:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788918698.276372:0:14969:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788918698.276399:0:14969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac9d6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d74 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.276413:0:14969:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fff48dda00/0x2811b8b2b0ac9d6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d74 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918698.276641:0:14969:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94fffcaab000 from 1 10000000:01000000:1.0:1788918698.276645:0:14969:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788918698.276711:0:14969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.276720:0:14969:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.276733:0:14969:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918698.276787:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865684992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788918698.276852:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918698.276905:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2fbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788918698.276989:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865684992 00000100:00100000:3.0:1788918698.276998:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865684992 00000100:00100000:3.0:1788918698.277130:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788918698.277140:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff743850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+9:14969:x1875816865684992:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788918698.277155:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918698.277176:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac9df2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9deb expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918698.277200:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac9df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9deb expref: 10 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918698.277212:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac9df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9deb expref: 10 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918698.277222:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0030800, rc 0) 00000100:00100000:3.0:1788918698.277273:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff743850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+10:14969:x1875816865684992:12345-0@lo:101:mount.lustre.0 Request processed in 134us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918698.277280:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788918698.277467:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865684992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788918698.277482:0:14969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9df2 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.277501:0:14969:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9df2 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918698.278089:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865685120:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788918698.278137:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918698.278177:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99840 going to sleep for 11 seconds 00000100:00100000:1.0:1788918698.278388:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865685120 00000100:00100000:1.0:1788918698.278396:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865685120 00000100:00100000:1.0:1788918698.278444:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788918698.278464:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+10:14969:x1875816865685120:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788918698.278484:0:14982:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788918698.278501:0:14982:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788918698.278583:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+10:14969:x1875816865685120:12345-0@lo:256:mount.lustre.0 Request processed in 131us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918698.278590:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788918698.278860:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865685120:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788918698.279642:0:14969:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788918698.279676:0:14969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9df2 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.279688:0:14969:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9df2 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918698.279698:0:14969:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94fffcaab000 from 1 10000000:01000000:2.0:1788918698.279701:0:14969:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788918698.279739:0:14969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.279747:0:14969:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.279757:0:14969:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918698.279778:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865685248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788918698.279830:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918698.279862:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99840 going to sleep for 11 seconds 00000100:00100000:1.0:1788918698.280103:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865685248 00000100:00100000:1.0:1788918698.280110:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865685248 00000100:00100000:1.0:1788918698.280152:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788918698.280160:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+10:14969:x1875816865685248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788918698.280173:0:14983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918698.280188:0:14983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcbc4200/0x2811b8b2b0ac9e00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9df9 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.280213:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcbc4200/0x2811b8b2b0ac9e00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9df9 expref: 11 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.280224:0:14983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcbc4200/0x2811b8b2b0ac9e00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9df9 expref: 11 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.280234:0:14983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4200, rc 0) 00000100:00100000:1.0:1788918698.280281:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:14969:x1875816865685248:12345-0@lo:101:mount.lustre.0 Request processed in 121us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918698.280288:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788918698.282151:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865685248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788918698.282252:0:14969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e00 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.282264:0:14969:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9e00 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918698.282346:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865685376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788918698.282398:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918698.282449:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99840 going to sleep for 11 seconds 00000100:00100000:0.0:1788918698.282601:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865685376 00000100:00100000:0.0:1788918698.282609:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865685376 00000100:00100000:0.0:1788918698.282672:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788918698.282682:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:14969:x1875816865685376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788918698.282860:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:14969:x1875816865685376:12345-0@lo:501:mount.lustre.0 Request processed in 179us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918698.282868:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788918698.283385:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865685376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788918698.283419:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865685504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788918698.283480:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918698.283519:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99840 going to sleep for 11 seconds 00000100:00100000:1.0:1788918698.283686:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865685504 00000100:00100000:1.0:1788918698.283691:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865685504 00000100:00100000:1.0:1788918698.283724:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788918698.283732:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff740050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:14969:x1875816865685504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788918698.283823:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff740050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:14969:x1875816865685504:12345-0@lo:503:mount.lustre.0 Request processed in 92us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918698.283831:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788918698.283979:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865685504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788918698.284642:0:15016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15016:1875816865685632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918698.284704:0:15016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918698.284740:0:15016:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc8b35000 going to sleep for 11 seconds 00000100:00100000:1.0:1788918698.284784:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865685632 00000100:00100000:1.0:1788918698.284789:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865685632 00000100:00100000:1.0:1788918698.284822:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788918698.284829:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff740c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:15016:x1875816865685632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788918698.285746:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff740c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:15016:x1875816865685632:12345-0@lo:502:llog_process_th.0 Request processed in 914us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918698.285755:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788918698.286183:0:15016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15016:1875816865685632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788918698.286226:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788918698.286240:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918698.286243:0:15016:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788918698.286250:0:15016:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94fffcaab000 00000020:00000080:3.0:1788918698.286253:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788918698.286261:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918698.286263:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918698.286264:0:15016:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788918698.286267:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788918698.286269:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918698.286270:0:15016:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788918698.286272:0:15016:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94fffcaab000 00000020:00000080:3.0:1788918698.286274:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788918698.286349:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918698.286352:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918698.286354:0:15016:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788918698.286356:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788918698.286359:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918698.286361:0:15016:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788918698.286364:0:15016:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94fffcaab000 00000020:00000080:3.0:1788918698.286367:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788918698.286416:0:15016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15016:1875816865685760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788918698.286480:0:15016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918698.286516:0:15016:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffcb2af300 going to sleep for 11 seconds 00000100:00100000:0.0:1788918698.288003:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865685760 00000100:00100000:0.0:1788918698.288015:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865685760 00000100:00100000:0.0:1788918698.288112:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788918698.288124:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff740850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:15016:x1875816865685760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918698.288314:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff740850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:15016:x1875816865685760:12345-0@lo:502:llog_process_th.0 Request processed in 192us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918698.288322:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788918698.289180:0:15016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15016:1875816865685760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788918698.289225:0:15016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918698.289234:0:15016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918698.289236:0:15016:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788918698.289241:0:15016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788918698.289440:0:14969:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788918698.289480:0:14969:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788918698.289516:0:14969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e00 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.289530:0:14969:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e00 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918698.289586:0:14969:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788918698.289590:0:14969:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94fffcaab000 10000000:01000000:0.0:1788918698.289593:0:14969:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94fffcaab000 10000000:01000000:0.0:1788918698.289597:0:14969:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788918698.289604:0:14969:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94fffcaab000 from 1 10000000:01000000:0.0:1788918698.289607:0:14969:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788918698.289663:0:14969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcb20600/0x2811b8b2b0ac9e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.289672:0:14969:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fffcb20600/0x2811b8b2b0ac9e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.289683:0:14969:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fffcb20600/0x2811b8b2b0ac9e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918698.289708:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865685888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788918698.289766:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918698.289800:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68749c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918698.290529:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865685888 00000100:00100000:1.0:1788918698.290538:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865685888 00000100:00100000:1.0:1788918698.290587:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788918698.290597:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:14969:x1875816865685888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788918698.290611:0:14982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918698.290625:0:14982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcbc5a00/0x2811b8b2b0ac9e0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9e07 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.290665:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcbc5a00/0x2811b8b2b0ac9e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e07 expref: 12 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.290690:0:14982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcbc5a00/0x2811b8b2b0ac9e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e07 expref: 12 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.290700:0:14982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5a00, rc 0) 00000100:00100000:1.0:1788918698.290753:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14969:x1875816865685888:12345-0@lo:101:mount.lustre.0 Request processed in 157us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918698.290761:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788918698.292751:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865685888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788918698.292788:0:14969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fffcb20600/0x2811b8b2b0ac9e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e0e expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.292802:0:14969:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fffcb20600/0x2811b8b2b0ac9e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9e0e expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918698.292921:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865686016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788918698.292997:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918698.293059:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68749c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918698.293697:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865686016 00000100:00100000:1.0:1788918698.293705:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865686016 00000100:00100000:1.0:1788918698.293768:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788918698.293779:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14969:x1875816865686016:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788918698.293968:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14969:x1875816865686016:12345-0@lo:501:mount.lustre.0 Request processed in 189us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918698.293977:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788918698.294161:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865686016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788918698.294206:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865686144:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788918698.294252:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918698.294286:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff68749c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918698.298330:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865686144 00000100:00100000:1.0:1788918698.298352:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865686144 00000100:00100000:1.0:1788918698.298424:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788918698.298434:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14969:x1875816865686144:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788918698.299167:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14969:x1875816865686144:12345-0@lo:503:mount.lustre.0 Request processed in 731us (4911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918698.299178:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788918698.300680:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865686144:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788918698.303289:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15018:1875816865686272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918698.303375:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918698.303423:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865686272 00000100:00100000:0.0:1788918698.303431:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865686272 00000100:00100000:0.0:1788918698.303486:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788918698.305645:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:15018:x1875816865686272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918698.305864:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:15018:x1875816865686272:12345-0@lo:502:llog_process_th.0 Request processed in 240us (2488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918698.310861:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788918698.310962:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6874540 going to sleep for 11 seconds 00000100:00100000:0.0:1788918698.311001:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15018:1875816865686272:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788918698.311103:0:15018:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788918698.311122:0:15018:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff94ffe8dbb380) 00000020:00000080:0.0:1788918698.311148:0:15018:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788918698.311274:0:15018:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94fffcaab000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788918698.311279:0:15018:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94fffcaab000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788918698.311282:0:15018:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94fffcaab000 4 00010000:00080000:0.0:1788918698.311314:0:15018:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94ffefe71800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.149@tcp at head 00010000:00010000:0.0:1788918698.312997:0:15018:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788918698.313262:0:15018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788918698.313306:0:15018:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788918698.313323:0:15018:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2811b8b2b0ac9e1c 00000100:00080000:0.0:1788918698.313335:0:15018:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788918698.313342:0:15018:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94ffefe71800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:0.0:1788918698.313384:0:15018:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffffaf4e00 x1875816865686400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788918698.313444:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1875816865686400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788918698.313522:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788918698.313580:0:15018:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788918698.313751:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865686400 00000100:00100000:2.0:1788918698.313760:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865686400 00000100:00100000:2.0:1788918698.313800:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788918698.313808:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3416:x1875816865686400:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788918698.313872:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3416:x1875816865686400:12345-0@lo:38:llog_process_th.0 Request processed in 64us (350us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788918698.313880:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788918698.331351:0:3416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788918698.331369:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94ffefe71800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788918698.331379:0:3416:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788918698.331385:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1875816865686400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788918698.335910:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15018:1875816865686528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918698.336005:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918698.336079:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865686528 00000100:00100000:0.0:1788918698.336094:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865686528 00000100:00100000:0.0:1788918698.336147:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788918698.336157:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:15018:x1875816865686528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788918698.336286:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:15018:x1875816865686528:12345-0@lo:502:llog_process_th.0 Request processed in 129us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918698.336294:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788918698.336427:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6874a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918698.336451:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15018:1875816865686528:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788918698.336483:0:15018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788918698.336708:0:14969:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788918698.336729:0:14969:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788918698.336746:0:14969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcb20600/0x2811b8b2b0ac9e07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e0e expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.336758:0:14969:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fffcb20600/0x2811b8b2b0ac9e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e0e expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788918698.336806:0:14969:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788918698.336808:0:14969:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788918698.336810:0:14969:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788918698.336811:0:14969:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788918698.336812:0:14969:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788918698.336813:0:14969:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788918698.336814:0:14969:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788918698.336816:0:14969:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788918698.336817:0:14969:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788918698.336819:0:14969:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788918698.336822:0:14969:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788918698.336825:0:14969:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788918698.336826:0:14969:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788918698.336827:0:14969:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788918698.336828:0:14969:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788918698.336833:0:14969:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788918698.336834:0:14969:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788918698.336835:0:14969:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788918698.336836:0:14969:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788918698.336836:0:14969:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788918698.336837:0:14969:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788918698.336851:0:14969:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788918698.336861:0:14969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865686656:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788918698.336960:0:14969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918698.336975:0:14969:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fff6874a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918698.336999:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865686656 00000100:00100000:0.0:1788918698.337004:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865686656 00000100:00100000:0.0:1788918698.337056:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788918698.337063:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14969:x1875816865686656:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788918698.337085:0:14983:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788918698.337097:0:14983:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788918698.342347:0:14983:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788918698.342370:0:14983:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788918698.345828:0:15006:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788918698.345842:0:15006:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1788918698.346214:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14969:x1875816865686656:12345-0@lo:253:mount.lustre.0 Request processed in 9146us (9248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918698.346227:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788918698.346299:0:14969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14969:1875816865686656:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788918698.346315:0:14969:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788918698.346318:0:14969:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788918698.346320:0:14969:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788918698.346322:0:14969:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788918698.346323:0:14969:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788918698.346324:0:14969:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788918698.346325:0:14969:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788918698.346326:0:14969:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788918698.346328:0:14969:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788918698.346330:0:14969:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788918698.346332:0:14969:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788918698.346355:0:14969:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788918698.346580:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.346599:0:15006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac9df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9deb expref: 11 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.346618:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.346673:0:15006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac9df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac9deb expref: 11 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.346691:0:15006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac9df2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9deb expref: 11 pid: 14985 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918698.346711:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15006:1875816865686784:0@lo:104: 00000100:00100000:2.0:1788918698.346756:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918698.346796:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe09d2780 going to sleep for 11 seconds 00000100:00100000:1.0:1788918698.347758:0:14973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865686784 00000100:00100000:1.0:1788918698.347767:0:14973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865686784 00000100:00100000:1.0:1788918698.347816:0:14973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788918698.347825:0:14973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+3:15006:x1875816865686784:12345-0@lo:104: 00010000:00010000:1.0:1788918698.347840:0:14973:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9df2 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.347945:0:14973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788918698.347952:0:14973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+3:15006:x1875816865686784:12345-0@lo:104: Request processed in 129us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918698.347961:0:14973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788918698.356192:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15006:1875816865686784:0@lo:104: 00010000:00010000:2.0:1788918698.356231:0:15006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.364737:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918698.364754:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9df2 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.364768:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5000 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918698.364773:0:14979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac9df2 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.364786:0:14979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac9df2 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918698.364795:0:14979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac9df2 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918698.364801:0:14979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788918698.364860:0:14979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9df2 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.364868:0:14979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918698.364909:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9df2 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.364917:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9deb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9df2 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.364956:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918698.364958:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918698.364960:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918698.365015:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865686912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788918698.365107:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918698.367073:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865686912 00000100:00100000:2.0:1788918698.367084:0:14975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865686912 00010000:00010000:2.0:1788918698.367120:0:14975:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac9df2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9deb expref: 12 pid: 14985 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918698.367160:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788918698.367170:0:14975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:3420:x1875816865686912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788918698.367186:0:14975:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918698.367192:0:14975:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac9df2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9deb expref: 12 pid: 14985 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.367205:0:14975:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac9df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9deb expref: 12 pid: 14985 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.367233:0:14975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc0030800/0x2811b8b2b0ac9df2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac9deb expref: 12 pid: 14985 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.367252:0:14975:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.367261:0:14975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788918698.367279:0:14975:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.021438088s 00010000:00010000:2.0:1788918698.367284:0:14975:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.367291:0:14975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.367298:0:14975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.367305:0:14975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.367311:0:14975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918698.367315:0:14975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.367325:0:14975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.367339:0:14975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.367356:0:14975:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918698.367425:0:14975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:3420:x1875816865686912:12345-0@lo:103:ldlm_bl.0 Request processed in 256us (2318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918698.367433:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788918698.367460:0:15006:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.367469:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918698.367476:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9e23 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918698.368218:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865686912:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788918698.397934:0:14969:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788918698.398671:0:14969:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788918698.400095:0:15027:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788918698.400100:0:15027:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788918698.400378:0:15028:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788918698.400786:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788918698.403883:0:14969:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788918698.403962:0:14969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788918698.405199:0:14969:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788918698.405213:0:14969:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788918698.405590:0:14969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788918698.406091:0:15028:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788918698.406178:0:15028:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788918698.406182:0:15028:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788918698.407770:0:14969:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788918698.408670:0:14969:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788918698.408734:0:14969:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788918698.410768:0:14969:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788918698.413004:0:14969:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788918698.414736:0:14969:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788918698.414773:0:14969:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa86d81c83988 00100000:10000000:0.0:1788918698.414781:0:14969:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788918698.415960:0:14969:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788918698.415989:0:14969:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.149@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788918698.416007:0:14969:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788918698.416045:0:14969:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788918698.418128:0:14969:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788918698.420837:0:14969:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788918698.715741:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788918698.902101:0:14987:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788918698.902110:0:14987:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94fffcaab000 from 6 10000000:01000000:3.0:1788918698.902116:0:14987:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788918698.902170:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918698.902183:0:14987:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918698.902195:0:14987:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918698.902223:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865687040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788918698.902292:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918698.902367:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe0704300 going to sleep for 11 seconds 00000100:00100000:0.0:1788918698.902444:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865687040 00000100:00100000:0.0:1788918698.902452:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865687040 00000100:00100000:0.0:1788918698.902525:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788918698.902535:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff740450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:14987:x1875816865687040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788918698.902552:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918698.902566:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcb20200/0x2811b8b2b0ac9e31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9e2a expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.902593:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcb20200/0x2811b8b2b0ac9e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e2a expref: 12 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.902605:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcb20200/0x2811b8b2b0ac9e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e2a expref: 12 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918698.902614:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20200, rc 0) 00000100:00100000:0.0:1788918698.902668:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff740450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14987:x1875816865687040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918698.902675:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788918698.902848:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865687040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918698.902863:0:14987:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e31 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918698.902874:0:14987:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9e31 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918698.902931:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865687168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788918698.902963:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918698.902986:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe0704300 going to sleep for 11 seconds 00000100:00100000:1.0:1788918698.903080:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865687168 00000100:00100000:1.0:1788918698.903086:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865687168 00000100:00100000:1.0:1788918698.903122:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788918698.903129:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14987:x1875816865687168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788918698.903144:0:14982:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788918698.903161:0:14982:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788918698.903164:0:14982:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788918698.903241:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14987:x1875816865687168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918698.903248:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788918698.903282:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865687168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788918698.903323:0:14987:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788918698.903334:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e31 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918698.903344:0:14987:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e31 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788918699.416831:0:15024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788918699.735411:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788918700.438726:0:15024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788918700.758173:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918701.784992:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918702.806291:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788918703.702152:0:14398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788918703.702160:0:14398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788918703.702163:0:14398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788918703.702166:0:14398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788918703.702168:0:14398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788918703.702172:0:14398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788918703.702175:0:14398:0:(import.c:65:import_set_state_nolock()) ffff94ffefe71800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788918703.702193:0:14398:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94ffefe71800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:0.0:1788918703.702221:0:14398:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffffaf4000 x1875816865687424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788918703.702283:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3417:1875816865687296:0@lo:400:kworker.0 00000100:00100000:0.0:1788918703.702357:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918703.702437:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1875816865687424:0@lo:38:kworker.0 00000100:00100000:0.0:1788918703.702482:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918703.705512:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865687424 00000100:00100000:3.0:1788918703.705528:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865687424 00000100:00100000:1.0:1788918703.707106:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865687296 00000100:00100000:1.0:1788918703.707121:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865687296 00000100:00100000:1.0:1788918703.707183:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788918703.707194:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:3417:x1875816865687296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918703.707323:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:3417:x1875816865687296:12345-0@lo:400:kworker.0 Request processed in 130us (4965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918703.707330:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788918703.707403:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3417:1875816865687296:0@lo:400:kworker.0 00000100:00100000:3.0:1788918703.708161:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788918703.708170:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3416:x1875816865687424:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788918703.708199:0:14992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:3.0:1788918703.708241:0:14992:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2811b8b2b0ac9e38 00000004:00100000:3.0:1788918703.708259:0:14992:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788918703.708418:0:14992:0:(import.c:65:import_set_state_nolock()) ffff94ffd0888800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788918703.708621:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3416:x1875816865687424:12345-0@lo:38:kworker.0 Request processed in 449us (6136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918703.708628:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788918703.710150:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94ffffaf4000 x1875816865687424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788918713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788918703.710173:0:3416:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788918703.710182:0:3416:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788918703.710188:0:3416:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788918703.710191:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94ffefe71800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788918703.710200:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3416:1875816865687424:0@lo:38:kworker.0 00000001:02000400:0.0:1788918703.722905:0:15270:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788918703.830238:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918704.854377:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788918704.863322:0:15323:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788918704.863548:0:15323:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788918705.886106:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788918705.910873:0:15373:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788918705.911068:0:15373:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788918706.914121:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788918707.035490:0:15421:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb1a0a1e0 20000000:00000080:3.0:1788918707.035515:0:15421:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94fffcf11c00 uarg=0000000000000000 20000000:01000000:3.0:1788918707.035564:0:15421:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788918707.035847:0:15421:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788918707.035853:0:15421:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788918707.036480:0:15422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788918707.042502:0:15421:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788918707.048980:0:15421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788918707.049067:0:15421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.049095:0:15421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fffcbc4200/0x2811b8b2b0ac9e00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9df9 expref: 11 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.049107:0:15421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.049172:0:15421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fffcbc4200/0x2811b8b2b0ac9e00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac9df9 expref: 11 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.049192:0:15421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94fffcbc4200/0x2811b8b2b0ac9e00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9df9 expref: 11 pid: 14983 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918707.049210:0:15421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15421:1875816865687552:0@lo:104: 00000100:00100000:3.0:1788918707.049309:0:15421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918707.049387:0:15421:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd05af180 going to sleep for 11 seconds 00000100:00100000:1.0:1788918707.049404:0:14974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865687552 00000100:00100000:1.0:1788918707.049419:0:14974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865687552 00000100:00100000:1.0:1788918707.049506:0:14974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788918707.049516:0:14974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+3:15421:x1875816865687552:12345-0@lo:104: 00010000:00010000:1.0:1788918707.049537:0:14974:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9e00 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918707.049660:0:14974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788918707.049668:0:14974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+3:15421:x1875816865687552:12345-0@lo:104: Request processed in 154us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918707.049685:0:14974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788918707.049711:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918707.049717:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9e00 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918707.049725:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd000 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918707.049729:0:14979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac9e00 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918707.049738:0:14979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac9e00 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918707.049745:0:14979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac9e00 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918707.049751:0:14979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788918707.049792:0:14979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9e00 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918707.049798:0:14979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918707.049819:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9e00 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918707.049836:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94fff48dd000/0x2811b8b2b0ac9df9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9e00 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918707.049856:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918707.049858:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918707.049859:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918707.049875:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3418:1875816865687680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788918707.049909:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918707.049968:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865687680 00000100:00100000:3.0:1788918707.049977:0:14975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865687680 00010000:00010000:3.0:1788918707.050016:0:14975:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fffcbc4200/0x2811b8b2b0ac9e00 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9df9 expref: 12 pid: 14983 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918707.050075:0:15421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15421:1875816865687552:0@lo:104: 00000100:00100000:3.0:1788918707.050100:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788918707.050105:0:15421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918707.050114:0:14975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:3418:x1875816865687680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788918707.050142:0:14975:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918707.050150:0:14975:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fffcbc4200/0x2811b8b2b0ac9e00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9df9 expref: 12 pid: 14983 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.050163:0:14975:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fffcbc4200/0x2811b8b2b0ac9e00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9df9 expref: 12 pid: 14983 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.050181:0:14975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fffcbc4200/0x2811b8b2b0ac9e00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac9df9 expref: 12 pid: 14983 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.050198:0:14975:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.050208:0:14975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.050223:0:14975:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.050232:0:14975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.050240:0:14975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.050248:0:14975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.050255:0:14975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031e00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918707.050260:0:14975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.050281:0:14975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.050302:0:14975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918707.050317:0:14975:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918707.050371:0:14975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:3418:x1875816865687680:12345-0@lo:103:ldlm_bl.0 Request processed in 262us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918707.050379:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788918707.050414:0:15421:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918707.050439:0:15421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918707.050446:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3418:1875816865687680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788918707.050448:0:15421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffc0031e00/0x2811b8b2b0ac9e3f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918707.927036:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788918708.182153:0:14987:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788918708.182163:0:14987:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94fffcaab000 from 10 10000000:01000000:3.0:1788918708.182170:0:14987:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788918708.182224:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918708.182238:0:14987:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918708.182250:0:14987:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918708.182277:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865687808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788918708.182347:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918708.182415:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd05af0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918708.183052:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865687808 00000100:00100000:2.0:1788918708.183063:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865687808 00000100:00100000:2.0:1788918708.183117:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788918708.183127:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+11:14987:x1875816865687808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918708.183157:0:14983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918708.183173:0:14983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac9e4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9e46 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918708.183199:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac9e4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e46 expref: 12 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918708.183209:0:14983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac9e4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e46 expref: 12 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918708.183218:0:14983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd800, rc 0) 00000100:00100000:2.0:1788918708.183277:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14987:x1875816865687808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918708.183284:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788918708.183343:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865687808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918708.183359:0:14987:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e4d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918708.183368:0:14987:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9e4d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918708.183462:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865687936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788918708.183493:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918708.183512:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe09d2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788918708.183528:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865687936 00000100:00100000:2.0:1788918708.183531:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865687936 00000100:00100000:2.0:1788918708.183554:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788918708.183572:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14987:x1875816865687936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788918708.183826:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14987:x1875816865687936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918708.183834:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788918708.183868:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865687936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788918708.183899:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865688064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918708.183939:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918708.183953:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffe09d2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788918708.183963:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865688064 00000100:00100000:2.0:1788918708.183967:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865688064 00000100:00100000:2.0:1788918708.183988:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788918708.183995:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14987:x1875816865688064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918708.184094:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:14987:x1875816865688064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918708.184100:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788918708.184136:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865688064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788918708.186169:0:15461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788918708.197873:0:14987:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788918708.197912:0:14987:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788918708.197947:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e4d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918708.197961:0:14987:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e4d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918708.824286:0:3416:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788918698/real 1788918698] req@ffff94ffffa8bb80 x1875816865684736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788918708 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918708.824320:0:3416:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94ffffa8bb80 x1875816865684736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788918708 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918708.824332:0:3416:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788918698/real 1788918698] req@ffff94ffefcb0380 x1875816865684608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788918708 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918708.824345:0:3416:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94ffefcb0380 x1875816865684608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788918708 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788918708.824375:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94ffd0565800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788918708.824409:0:3416:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788918708.824414:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865684736:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788918708.824422:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94fffc8e7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788918708.824440:0:3416:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788918708.824444:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865684608:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788918708.824523:0:14398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788918708.824528:0:14398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788918708.824531:0:14398:0:(import.c:65:import_set_state_nolock()) ffff94fffc8e7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788918708.824537:0:14398:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 400 00000100:00080000:3.0:1788918708.824542:0:14398:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788918708.824548:0:14398:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94fffc8e7000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788918708.824575:0:14398:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffefcb2a00 x1875816865688320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788918708.824589:0:14398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788918708.824592:0:14398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788918708.824594:0:14398:0:(import.c:65:import_set_state_nolock()) ffff94ffd0565800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788918708.824596:0:14398:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 400 00000100:00080000:3.0:1788918708.824599:0:14398:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788918708.824602:0:14398:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94ffd0565800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788918708.824611:0:14398:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffefcb1c00 x1875816865688448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788918708.824643:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865688576:0@lo:400:kworker.0 00000100:00100000:3.0:1788918708.824714:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918708.824765:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788918708.824771:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865688192:0@lo:400:kworker.0 00000100:00100000:3.0:1788918708.824807:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918708.824861:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865688576 00000100:00100000:3.0:1788918708.824867:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865688576 00000100:00100000:3.0:1788918708.824919:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788918708.824929:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865688576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918708.824982:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865688576:12345-0@lo:400:kworker.0 Request processed in 55us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918708.824989:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788918708.825011:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865688192 00000100:00100000:3.0:1788918708.825014:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865688192 00000100:00100000:3.0:1788918708.825064:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788918708.825072:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:3420:x1875816865688192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918708.825099:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:3420:x1875816865688192:12345-0@lo:400:kworker.0 Request processed in 29us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918708.825105:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788918708.825134:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865688320:0@lo:8:kworker.0 00000400:00000100:3.0:1788918708.825155:0:3416:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875816865688320 offset 0 length 520: 4 00000100:00100000:3.0:1788918708.825172:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865688448:0@lo:8:kworker.0 00000400:00000100:3.0:1788918708.825190:0:3416:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875816865688448 offset 0 length 520: 4 00000100:00100000:3.0:1788918708.825220:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865688192:0@lo:400:kworker.0 00010000:00080000:3.0:1788918708.825231:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94ffefcb1500 x1875816865688576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918708.825240:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865688576:0@lo:400:kworker.0 00010000:00010000:1.0:1788918708.950290:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918709.977352:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788918710.679643:0:15024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788918711.019170:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918712.023219:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918713.047309:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788918713.949251:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788918713.949258:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788918713.949262:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788918713.949265:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788918713.949304:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3417:1875816865688704:0@lo:400:kworker.0 00000100:00100000:0.0:1788918713.949391:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918713.949447:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788918713.949457:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865688832:0@lo:400:kworker.0 00000100:00100000:0.0:1788918713.949489:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918713.949546:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865688704 00000100:00100000:0.0:1788918713.949554:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865688704 00000100:00100000:0.0:1788918713.949605:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788918713.949618:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:3417:x1875816865688704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918713.949675:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:3417:x1875816865688704:12345-0@lo:400:kworker.0 Request processed in 62us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918713.949682:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788918713.949736:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865688832 00000100:00100000:0.0:1788918713.949741:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865688832 00000100:00100000:0.0:1788918713.949908:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788918713.949932:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865688832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918713.949979:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865688832:12345-0@lo:400:kworker.0 Request processed in 51us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918713.949986:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788918713.950063:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94ffffaf5880 x1875816865688832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918713.950079:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865688832:0@lo:400:kworker.0 00000100:00100000:0.0:1788918713.950092:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3417:1875816865688704:0@lo:400:kworker.0 00010000:00010000:1.0:1788918714.070731:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788918714.894258:0:15769:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788918714.894262:0:15769:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788918714.894263:0:15769:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788918714.894601:0:15769:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94ffc8961000 00000020:01000004:0.0:1788918714.894620:0:15769:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788918714.894632:0:15769:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788918714.894646:0:15769:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff94ffe8db99c0) 00000020:00000080:0.0:1788918714.894662:0:15769:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788918714.945333:0:15769:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788918714.946547:0:15769:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788918714.946976:0:15769:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788918714.947327:0:15769:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788918714.947761:0:15769:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788918714.947964:0:15769:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788918714.948204:0:15769:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:0.0:1788918714.951517:0:15769:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788918714.951741:0:15769:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788918714.951753:0:15769:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788918714.951765:0:15769:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2811b8b2b0ac9e5b 00000020:01000004:0.0:1788918714.951773:0:15769:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788918714.951796:0:15769:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.149@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788918714.951800:0:15769:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788918714.951805:0:15769:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788918714.951809:0:15769:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788918714.951822:0:15769:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff94ffc9130000) 00000020:00000080:0.0:1788918714.951833:0:15769:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788918714.952971:0:15769:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918714.953176:0:15769:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788918714.953189:0:15769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788918714.960450:0:15769:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788918714.960465:0:15769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788918714.960808:0:15769:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788918714.960814:0:15769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788918714.963137:0:15769:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918714.963516:0:15769:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788918714.963524:0:15769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788918714.965729:0:15769:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788918714.965738:0:15769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788918714.999672:0:15769:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788918715.000102:0:15769:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788918715.000110:0:15769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788918715.001894:0:15769:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788918715.001909:0:15769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788918715.002902:0:15769:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788918715.002914:0:15769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788918715.005877:0:15769:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918715.006120:0:15769:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788918715.006127:0:15769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788918715.007200:0:15769:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788918715.007209:0:15769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788918715.047304:0:15769:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788918715.047933:0:15769:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788918715.047940:0:15769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788918715.053691:0:15769:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788918715.053707:0:15769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788918715.054467:0:15769:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788918715.054510:0:15769:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788918715.054516:0:15769:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.149@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788918715.071419:0:15769:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788918715.071468:0:15769:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.149@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788918715.071472:0:15769:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788918715.071474:0:15769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788918715.071475:0:15769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788918715.071476:0:15769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788918715.071478:0:15769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788918715.071479:0:15769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788918715.071481:0:15769:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788918715.071482:0:15769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788918715.071484:0:15769:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788918715.071487:0:15769:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788918715.071490:0:15769:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788918715.071491:0:15769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788918715.071492:0:15769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788918715.071504:0:15769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788918715.071505:0:15769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788918715.071507:0:15769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788918715.071508:0:15769:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788918715.071509:0:15769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788918715.071510:0:15769:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788918715.071549:0:15769:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788918715.071573:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865688960:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788918715.071672:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918715.071802:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc70406c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918715.079576:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865688960 00000100:00100000:3.0:1788918715.079598:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865688960 00000100:00100000:3.0:1788918715.079694:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788918715.079706:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:15769:x1875816865688960:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788918715.079769:0:14983:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788918715.079773:0:14983:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788918715.079777:0:14983:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788918715.080326:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:15769:x1875816865688960:12345-0@lo:253:mount.lustre.0 Request processed in 621us (8653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918715.080345:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788918715.080579:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865688960:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788918715.080597:0:15769:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788918715.080601:0:15769:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788918715.080602:0:15769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788918715.080603:0:15769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788918715.080604:0:15769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788918715.080605:0:15769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788918715.080606:0:15769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788918715.080608:0:15769:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788918715.080610:0:15769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788918715.080611:0:15769:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788918715.080785:0:15769:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94ffc8961000 from lustre-OST0000 10000000:01000000:1.0:1788918715.080830:0:15769:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788918715.080833:0:15769:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788918715.080839:0:15769:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94ffe8dbcd40 local copy 00010000:00010000:1.0:1788918715.080850:0:15769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dc600/0x2811b8b2b0ac9d51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d58 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918715.080957:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788918715.081005:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918715.081056:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865689088 00000100:00100000:0.0:1788918715.081061:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865689088 00000100:00100000:1.0:1788918715.081068:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99840 going to sleep for 11 seconds 00000100:00100000:0.0:1788918715.081101:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788918715.081109:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:15769:x1875816865689088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788918715.081463:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:15769:x1875816865689088:12345-0@lo:501:mount.lustre.0 Request processed in 354us (457us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788918715.081471:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788918715.081546:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689088:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788918715.081562:0:15769:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788918715.081581:0:15769:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788918715.081588:0:15769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dc600/0x2811b8b2b0ac9d51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d58 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.081597:0:15769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fff48dc600/0x2811b8b2b0ac9d51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d58 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918715.081622:0:15769:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94ffc8961000 10000000:01000000:1.0:1788918715.081627:0:15769:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788918715.081632:0:15769:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff94ffe8dbcd40 10000000:01000000:1.0:1788918715.081634:0:15769:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788918715.081639:0:15769:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff94ffe8dbcd40 from 1 10000000:01000000:1.0:1788918715.081642:0:15769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788918715.081669:0:15769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9e69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.081677:0:15769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9e69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.081686:0:15769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9e69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918715.081698:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788918715.081725:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918715.081757:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99840 going to sleep for 11 seconds 00000100:00100000:3.0:1788918715.081813:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865689216 00000100:00100000:3.0:1788918715.081818:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865689216 00000100:00100000:3.0:1788918715.081856:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788918715.081863:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+12:15769:x1875816865689216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788918715.081873:0:14983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918715.081887:0:14983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffc0031600/0x2811b8b2b0ac9e70 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9e69 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918715.081909:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffc0031600/0x2811b8b2b0ac9e70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e69 expref: 13 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918715.081920:0:14983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffc0031600/0x2811b8b2b0ac9e70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e69 expref: 13 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918715.081936:0:14983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffc0031600, rc 0) 00000100:00100000:3.0:1788918715.081975:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+13:15769:x1875816865689216:12345-0@lo:101:mount.lustre.0 Request processed in 112us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918715.081981:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788918715.082061:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788918715.082073:0:15769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9e69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e70 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.082081:0:15769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9e69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9e70 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918715.082094:0:15769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788918715.082145:0:15769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9e69 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e70 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.082152:0:15769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5000/0x2811b8b2b0ac9e69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e70 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918715.082159:0:15769:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788918715.082163:0:15769:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788918715.082166:0:15769:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788918715.082168:0:15769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788918715.082182:0:15769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5800/0x2811b8b2b0ac9e77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.082189:0:15769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5800/0x2811b8b2b0ac9e77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.082196:0:15769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5800/0x2811b8b2b0ac9e77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918715.082208:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788918715.082234:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918715.082272:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99840 going to sleep for 11 seconds 00000100:00100000:0.0:1788918715.082366:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865689344 00000100:00100000:0.0:1788918715.082371:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865689344 00000100:00100000:0.0:1788918715.082404:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788918715.082410:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+13:15769:x1875816865689344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788918715.082418:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918715.082427:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcb21600/0x2811b8b2b0ac9e7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9e77 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918715.082441:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcb21600/0x2811b8b2b0ac9e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e77 expref: 14 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918715.082449:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcb21600/0x2811b8b2b0ac9e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e77 expref: 14 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918715.082455:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21600, rc 0) 00000100:00100000:0.0:1788918715.082493:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+14:15769:x1875816865689344:12345-0@lo:101:mount.lustre.0 Request processed in 83us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918715.082509:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788918715.082577:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788918715.082587:0:15769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5800/0x2811b8b2b0ac9e77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e7e expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.082595:0:15769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5800/0x2811b8b2b0ac9e77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9e7e expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788918715.085172:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788918715.085802:0:15769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788918715.088845:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788918715.088904:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788918715.088922:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788918715.088936:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788918715.088949:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788918715.088961:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788918715.088986:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788918715.088992:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788918715.090454:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788918715.090560:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918715.090608:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918715.090621:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865689472 00000100:00100000:0.0:1788918715.090630:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865689472 00000100:00100000:0.0:1788918715.090689:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788918715.090699:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+14:15769:x1875816865689472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788918715.090873:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+14:15769:x1875816865689472:12345-0@lo:501:mount.lustre.0 Request processed in 174us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918715.090896:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788918715.091117:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788918715.091156:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788918715.091198:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918715.091226:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918715.091239:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865689600 00000100:00100000:0.0:1788918715.091243:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865689600 00000100:00100000:0.0:1788918715.091275:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788918715.091281:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+14:15769:x1875816865689600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788918715.092003:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+14:15769:x1875816865689600:12345-0@lo:503:mount.lustre.0 Request processed in 719us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918715.092012:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788918715.092142:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689600:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788918715.093466:0:15769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788918715.093564:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788918715.093638:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918715.093684:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffc8a7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788918715.093704:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865689728 00000100:00100000:0.0:1788918715.093711:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865689728 00000100:00100000:0.0:1788918715.093755:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788918715.093764:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+14:15769:x1875816865689728:12345-0@lo:502:mount.lustre.0 00010000:00010000:3.0:1788918715.094228:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918715.094401:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+14:15769:x1875816865689728:12345-0@lo:502:mount.lustre.0 Request processed in 636us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918715.094409:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788918715.094430:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788918715.094659:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788918715.094688:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788918715.094704:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788918715.094719:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788918715.094733:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788918715.094747:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788918715.094779:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788918715.094796:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788918715.094809:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788918715.094822:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788918715.094832:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788918715.094844:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788918715.094869:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788918715.094910:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918715.094944:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc7050300 going to sleep for 11 seconds 00000100:00100000:0.0:1788918715.095009:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865689856 00000100:00100000:0.0:1788918715.095014:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865689856 00000100:00100000:0.0:1788918715.095079:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788918715.095087:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+14:15769:x1875816865689856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788918715.095174:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+14:15769:x1875816865689856:12345-0@lo:502:mount.lustre.0 Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918715.095180:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788918715.095383:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788918715.095433:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788918715.095445:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788918715.096244:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788918715.096254:0:15786:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788918715.096261:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918715.096264:0:15786:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788918715.096274:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788918715.096291:0:15786:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff94ffc9134d40) 00000020:00000080:0.0:1788918715.096314:0:15786:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788918715.096320:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788918715.096398:0:15786:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94ffc8961000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788918715.096406:0:15786:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788918715.096412:0:15786:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2811b8b2b0ac9e8c 00010000:00010000:0.0:1788918715.100244:0:15786:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788918715.102094:0:15786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788918715.104290:0:15786:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788918715.105832:0:15786:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788918715.105844:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918715.105850:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918715.105852:0:15786:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788918715.105855:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788918715.105857:0:15786:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788918715.105859:0:15786:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788918715.105860:0:15786:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788918715.105862:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788918715.105865:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918715.105866:0:15786:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788918715.105868:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788918715.105871:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918715.105872:0:15786:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788918715.105875:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788918715.105877:0:15786:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788918715.105879:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918715.105881:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918715.105882:0:15786:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788918715.105884:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788918715.105886:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918715.105887:0:15786:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788918715.105890:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788918715.105913:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918715.105916:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918715.105917:0:15786:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788918715.105928:0:15786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788918715.108588:0:15769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788918715.108641:0:15769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788918715.108664:0:15769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5800/0x2811b8b2b0ac9e77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e7e expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918715.108677:0:15769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5800/0x2811b8b2b0ac9e77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e7e expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788918715.108707:0:15769:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94ffc8961000 from 1 10000000:01000000:2.0:1788918715.108711:0:15769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788918715.108754:0:15769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918715.108763:0:15769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918715.108775:0:15769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918715.108804:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689984:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788918715.108878:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918715.108928:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc7050300 going to sleep for 11 seconds 00000100:00100000:0.0:1788918715.108939:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865689984 00000100:00100000:0.0:1788918715.108948:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865689984 00000100:00100000:0.0:1788918715.109008:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788918715.109018:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+14:15769:x1875816865689984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788918715.109049:0:14982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918715.109062:0:14982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcb21400/0x2811b8b2b0ac9e9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9e93 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918715.109087:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcb21400/0x2811b8b2b0ac9e9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e93 expref: 15 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918715.109098:0:14982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcb21400/0x2811b8b2b0ac9e9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e93 expref: 15 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918715.109106:0:14982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21400, rc 0) 00000100:00100000:0.0:1788918715.109158:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+15:15769:x1875816865689984:12345-0@lo:101:mount.lustre.0 Request processed in 142us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918715.109165:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788918715.109245:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865689984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788918715.109261:0:15769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e9a expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918715.109270:0:15769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9e9a expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788918715.110690:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788918715.110968:0:15769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788918715.111206:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788918715.111232:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788918715.111252:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788918715.111257:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788918715.111322:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788918715.111403:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918715.111446:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc34fb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918715.111535:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865690112 00000100:00100000:0.0:1788918715.111543:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865690112 00000100:00100000:0.0:1788918715.111605:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788918715.111616:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+15:15769:x1875816865690112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788918715.111736:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+15:15769:x1875816865690112:12345-0@lo:501:mount.lustre.0 Request processed in 121us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918715.111744:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788918715.111826:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788918715.111861:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788918715.111912:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918715.111939:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc70509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918715.112078:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865690240 00000100:00100000:0.0:1788918715.112082:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865690240 00000100:00100000:0.0:1788918715.112110:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788918715.112116:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+15:15769:x1875816865690240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788918715.112186:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+15:15769:x1875816865690240:12345-0@lo:503:mount.lustre.0 Request processed in 69us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918715.112193:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788918715.112278:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690240:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788918715.112617:0:15769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788918715.112675:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788918715.112714:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918715.112746:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc70509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918715.112842:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865690368 00000100:00100000:0.0:1788918715.112848:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865690368 00000100:00100000:0.0:1788918715.112879:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788918715.112886:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+15:15769:x1875816865690368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788918715.112971:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+15:15769:x1875816865690368:12345-0@lo:502:mount.lustre.0 Request processed in 85us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918715.112977:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788918715.115169:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788918715.115416:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788918715.115457:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788918715.115472:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788918715.115485:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788918715.115515:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788918715.115531:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788918715.115543:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788918715.115569:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788918715.115602:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788918715.115668:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918715.115715:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc70509c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918715.117145:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865690496 00000100:00100000:3.0:1788918715.117156:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865690496 00000100:00100000:3.0:1788918715.117214:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788918715.117224:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+15:15769:x1875816865690496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788918715.117379:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+15:15769:x1875816865690496:12345-0@lo:502:mount.lustre.0 Request processed in 155us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918715.117387:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788918715.117850:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788918715.118002:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788918715.118016:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788918715.123268:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918715.123286:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918715.123289:0:15790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788918715.123297:0:15790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94ffc8961000 00000020:00000080:2.0:1788918715.123300:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788918715.123308:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918715.123311:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918715.123312:0:15790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788918715.123314:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918715.123317:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918715.123318:0:15790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788918715.123321:0:15790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94ffc8961000 00000020:00000080:2.0:1788918715.123323:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788918715.123375:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918715.123378:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918715.123380:0:15790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788918715.123383:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788918715.123385:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918715.123386:0:15790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788918715.123404:0:15790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94ffc8961000 00000020:00000080:2.0:1788918715.123406:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788918715.123432:0:15790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788918715.123435:0:15790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788918715.123436:0:15790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788918715.123439:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788918715.123526:0:15769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788918715.123562:0:15769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788918715.123589:0:15769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e9a expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918715.123615:0:15769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9e9a expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918715.123676:0:15769:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788918715.123680:0:15769:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94ffc8961000 10000000:01000000:3.0:1788918715.123683:0:15769:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94ffc8961000 10000000:01000000:3.0:1788918715.123687:0:15769:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788918715.123692:0:15769:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94ffc8961000 from 1 10000000:01000000:3.0:1788918715.123695:0:15769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788918715.123735:0:15769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac9ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918715.123743:0:15769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac9ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918715.123754:0:15769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac9ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918715.123780:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788918715.123861:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918715.123922:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd828bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788918715.124005:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865690624 00000100:00100000:2.0:1788918715.124014:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865690624 00000100:00100000:2.0:1788918715.124082:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788918715.124093:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+15:15769:x1875816865690624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788918715.124107:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918715.124121:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff48dde00/0x2811b8b2b0ac9ea8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9ea1 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918715.124143:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dde00/0x2811b8b2b0ac9ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9ea1 expref: 16 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918715.124154:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff48dde00/0x2811b8b2b0ac9ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9ea1 expref: 16 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918715.124163:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dde00, rc 0) 00000100:00100000:2.0:1788918715.124206:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:15769:x1875816865690624:12345-0@lo:101:mount.lustre.0 Request processed in 116us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918715.124213:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788918715.124265:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788918715.124281:0:15769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac9ea1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9ea8 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918715.124289:0:15769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac9ea1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9ea8 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788918715.126866:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788918715.127202:0:15769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788918715.127598:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788918715.127623:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788918715.127635:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788918715.127646:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788918715.127672:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788918715.127686:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788918715.127699:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788918715.127711:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788918715.127723:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788918715.127737:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788918715.127749:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788918715.127761:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788918715.127773:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788918715.127786:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788918715.127799:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788918715.127812:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788918715.127824:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788918715.127835:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788918715.127846:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788918715.127857:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788918715.127882:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788918715.127896:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788918715.127983:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788918715.127997:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788918715.128010:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788918715.128093:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788918715.128112:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788918715.128125:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788918715.128144:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788918715.128161:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788918715.128246:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788918715.128322:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918715.130914:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc7050c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788918715.140036:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865690752 00000100:00100000:3.0:1788918715.140052:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865690752 00000100:00100000:0.0:1788918715.140220:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788918715.140232:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:15769:x1875816865690752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788918715.140414:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:15769:x1875816865690752:12345-0@lo:501:mount.lustre.0 Request processed in 184us (12091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918715.140421:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788918715.141728:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788918715.141779:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788918715.141838:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918715.150926:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc7050c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788918715.151643:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865690880 00000100:00100000:3.0:1788918715.151657:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865690880 00000100:00100000:3.0:1788918715.151713:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788918715.151722:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:15769:x1875816865690880:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788918715.151885:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:15769:x1875816865690880:12345-0@lo:503:mount.lustre.0 Request processed in 163us (10046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918715.151962:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788918715.152057:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865690880:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788918715.152520:0:15769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788918715.152605:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865691008:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788918715.152659:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918715.152743:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc2f7b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788918715.152860:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865691008 00000100:00100000:0.0:1788918715.152866:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865691008 00000100:00100000:2.0:1788918715.153709:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788918715.153725:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:15769:x1875816865691008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788918715.153862:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:15769:x1875816865691008:12345-0@lo:502:mount.lustre.0 Request processed in 142us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918715.153870:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788918715.155146:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865691008:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788918715.155384:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788918715.155417:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788918715.155432:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788918715.155444:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788918715.155456:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788918715.155466:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788918715.155479:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788918715.155491:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788918715.155516:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788918715.155528:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788918715.155539:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788918715.155551:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788918715.155562:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788918715.155574:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788918715.155586:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788918715.155599:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788918715.155627:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788918715.155639:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788918715.155650:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788918715.155661:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788918715.155674:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788918715.155699:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788918715.155711:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788918715.155724:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788918715.155737:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788918715.155750:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788918715.155761:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788918715.155772:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788918715.155783:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788918715.155795:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788918715.155807:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788918715.155818:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788918715.155842:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788918715.155856:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788918715.155868:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788918715.155879:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788918715.155890:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788918715.159082:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788918715.159171:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788918715.159189:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788918715.159249:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865691136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788918715.159340:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918715.159383:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc2f7b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788918715.159467:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865691136 00000100:00100000:3.0:1788918715.159474:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865691136 00000100:00100000:3.0:1788918715.159533:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788918715.159542:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:15769:x1875816865691136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788918715.159663:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:15769:x1875816865691136:12345-0@lo:502:mount.lustre.0 Request processed in 121us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918715.159670:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788918715.159729:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865691136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788918715.159783:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788918715.159791:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788918715.174872:0:15795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788918715.174891:0:15795:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff94ffc91319c0) 00000020:00000080:0.0:1788918715.174925:0:15795:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788918715.175011:0:15795:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94ffc8961000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788918715.175015:0:15795:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94ffc8961000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788918715.175049:0:15795:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94ffc8961000 3 00010000:00080000:0.0:1788918715.175079:0:15795:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94ffd884b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.149@tcp at head 00010000:00010000:0.0:1788918715.179290:0:15795:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788918715.179589:0:15795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788918715.179635:0:15795:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788918715.179649:0:15795:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2811b8b2b0ac9eb6 00000100:00080000:0.0:1788918715.179660:0:15795:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788918715.179666:0:15795:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94ffd884b800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:0.0:1788918715.179704:0:15795:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffffaf6a00 x1875816865691264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788918715.179739:0:15795:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788918715.182587:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3416:1875816865691264:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788918715.182671:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788918715.182730:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788918715.182735:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788918715.182738:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788918715.182741:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788918715.182999:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865691264 00000100:00100000:3.0:1788918715.183007:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865691264 00000100:00100000:3.0:1788918715.183065:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788918715.183072:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3416:x1875816865691264:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788918715.183097:0:14992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:3.0:1788918715.183133:0:14992:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2811b8b2b0ac9ebd 00000004:00100000:3.0:1788918715.183147:0:14992:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788918715.183177:0:14992:0:(import.c:65:import_set_state_nolock()) ffff94ffff5e1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788918715.183225:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3416:x1875816865691264:12345-0@lo:38:llog_process_th.0 Request processed in 152us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918715.183232:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788918715.183254:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788918715.183261:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865691392:0@lo:400:kworker.0 00000100:00100000:3.0:1788918715.183287:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918715.183313:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865691392 00000100:00100000:3.0:1788918715.183316:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865691392 00000100:00100000:3.0:1788918715.183341:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788918715.183355:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865691392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918715.183388:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865691392:12345-0@lo:400:kworker.0 Request processed in 34us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918715.183395:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788918715.183427:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94ffffaf6a00 x1875816865691264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788918725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918715.183438:0:3416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788918715.183446:0:3416:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788918715.183453:0:3416:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788918715.183457:0:3416:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788918715.183460:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94ffd884b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788918715.183465:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3416:1875816865691264:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788918715.183509:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94ffefcb1880 x1875816865691392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918715.183519:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865691392:0@lo:400:kworker.0 00000040:00080000:0.0:1788918715.185798:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788918715.186194:0:15769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788918715.186226:0:15769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788918715.186250:0:15769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac9ea1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9ea8 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918715.186264:0:15769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc0030200/0x2811b8b2b0ac9ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9ea8 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788918715.186319:0:15769:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788918715.186322:0:15769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788918715.186323:0:15769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788918715.186330:0:15769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788918715.186331:0:15769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788918715.186332:0:15769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788918715.186334:0:15769:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788918715.186335:0:15769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788918715.186336:0:15769:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788918715.186340:0:15769:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788918715.186342:0:15769:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788918715.186343:0:15769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788918715.186344:0:15769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788918715.186345:0:15769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788918715.186346:0:15769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788918715.186347:0:15769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788918715.186347:0:15769:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788918715.186348:0:15769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788918715.186349:0:15769:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788918715.186372:0:15769:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788918715.186390:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865691520:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788918715.186455:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918715.186508:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc2f7b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788918715.186635:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865691520 00000100:00100000:0.0:1788918715.186642:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865691520 00000100:00100000:0.0:1788918715.186683:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788918715.186692:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:15769:x1875816865691520:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788918715.186717:0:14985:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788918715.186729:0:14985:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788918715.194716:0:14985:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788918715.194737:0:14985:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788918715.195060:0:15006:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788918715.195066:0:15006:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788918715.195087:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918715.195106:0:15006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fffcb20200/0x2811b8b2b0ac9e31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e2a expref: 16 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918715.195115:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918715.195134:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:15769:x1875816865691520:12345-0@lo:253:mount.lustre.0 Request processed in 8441us (8677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918715.195143:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1788918715.195154:0:15006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fffcb20200/0x2811b8b2b0ac9e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac9e2a expref: 16 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918715.195168:0:15006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94fffcb20200/0x2811b8b2b0ac9e31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e2a expref: 15 pid: 14985 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918715.195195:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15006:1875816865691648:0@lo:104: 00000100:00100000:2.0:1788918715.195250:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918715.195292:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc7050a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918715.195311:0:14974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865691648 00000100:00100000:0.0:1788918715.195326:0:14974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865691648 00000100:00100000:0.0:1788918715.195378:0:14974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788918715.195388:0:14974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+3:15006:x1875816865691648:12345-0@lo:104: 00010000:00010000:0.0:1788918715.195401:0:14974:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9e31 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918715.195448:0:14974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788918715.195454:0:14974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+3:15006:x1875816865691648:12345-0@lo:104: Request processed in 69us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918715.195458:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15006:1875816865691648:0@lo:104: 00000100:00100000:0.0:1788918715.195460:0:14974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788918715.195478:0:15006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195548:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918715.195555:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9e31 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195563:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030800 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918715.195567:0:14978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac9e31 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195576:0:14978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac9e31 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918715.195584:0:14978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac9e31 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918715.195589:0:14978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788918715.195663:0:14978:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9e31 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195670:0:14978:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918715.195689:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9e31 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195696:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc0030800/0x2811b8b2b0ac9e2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9e31 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195710:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918715.195712:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918715.195713:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918715.195724:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865691776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788918715.195761:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918715.195805:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865691776 00000100:00100000:1.0:1788918715.195810:0:14975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865691776 00010000:00010000:1.0:1788918715.195827:0:14975:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fffcb20200/0x2811b8b2b0ac9e31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e2a expref: 16 pid: 14985 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918715.195848:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788918715.195855:0:14975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:3420:x1875816865691776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788918715.195866:0:14975:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918715.195871:0:14975:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fffcb20200/0x2811b8b2b0ac9e31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e2a expref: 16 pid: 14985 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195881:0:14975:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fffcb20200/0x2811b8b2b0ac9e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e2a expref: 16 pid: 14985 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195893:0:14975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fffcb20200/0x2811b8b2b0ac9e31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e2a expref: 16 pid: 14985 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195904:0:14975:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195913:0:14975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788918715.195925:0:14975:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.021438088s 00010000:00010000:1.0:1788918715.195929:0:14975:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195935:0:14975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195952:0:14975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195959:0:14975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195965:0:14975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc800 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918715.195969:0:14975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195976:0:14975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.195991:0:14975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.196000:0:14975:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918715.196051:0:14975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+15:3420:x1875816865691776:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918715.196058:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788918715.196080:0:15006:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.196088:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918715.196093:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dc800/0x2811b8b2b0ac9ec4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918715.196703:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865691776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788918715.197090:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:15769:1875816865691520:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788918715.197104:0:15769:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788918715.197108:0:15769:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788918715.197110:0:15769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788918715.197111:0:15769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788918715.197112:0:15769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788918715.197113:0:15769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788918715.197115:0:15769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788918715.197116:0:15769:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788918715.197118:0:15769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788918715.197119:0:15769:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788918715.197134:0:15769:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1788918715.218409:0:15769:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788918715.223610:0:15769:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788918715.223621:0:15769:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788918715.223673:0:15769:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788918715.223718:0:15769:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.149@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788918715.223737:0:15769:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788918715.223765:0:15769:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788918715.224529:0:15769:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788918715.224736:0:15769:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788918716.120995:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788918716.165194:0:15847:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788918716.165412:0:15847:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788918717.153325:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788918717.157459:0:14987:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788918717.157467:0:14987:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94fffcaab000 from 7 10000000:01000000:3.0:1788918717.157472:0:14987:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788918717.157533:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918717.157546:0:14987:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918717.157557:0:14987:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918717.157584:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865691904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788918717.157663:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918717.157716:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc2f7b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788918717.157800:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865691904 00000100:00100000:0.0:1788918717.157808:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865691904 00000100:00100000:0.0:1788918717.157860:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788918717.157870:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+15:14987:x1875816865691904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788918717.157883:0:14982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918717.157897:0:14982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcb21a00/0x2811b8b2b0ac9ed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9ecb expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918717.157933:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcb21a00/0x2811b8b2b0ac9ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9ecb expref: 16 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918717.157945:0:14982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcb21a00/0x2811b8b2b0ac9ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9ecb expref: 16 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918717.157955:0:14982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb21a00, rc 0) 00000100:00100000:0.0:1788918717.157996:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:14987:x1875816865691904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918717.158003:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788918717.162985:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865691904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918717.163046:0:14987:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9ed2 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918717.163061:0:14987:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9ed2 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918717.163146:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865692032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788918717.163221:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918717.165151:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865692032 00000100:00100000:0.0:1788918717.165167:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865692032 00000100:00100000:0.0:1788918717.165225:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788918717.165235:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:14987:x1875816865692032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788918717.165263:0:14985:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788918717.165284:0:14985:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788918717.165288:0:14985:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788918717.165415:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:14987:x1875816865692032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 181us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918717.165423:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788918717.177048:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc2f7b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788918717.177098:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865692032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788918717.177182:0:14987:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788918717.177193:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9ed2 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918717.177205:0:14987:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9ed2 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918718.170391:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918719.190324:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918720.214926:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788918720.602348:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788918720.602355:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788918720.602358:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788918720.602361:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788918720.602418:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3417:1875816865692160:0@lo:400:kworker.0 00000100:00100000:0.0:1788918720.602501:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918720.602544:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788918720.602549:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865692288:0@lo:400:kworker.0 00000100:00100000:0.0:1788918720.602573:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918720.602603:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865692416:0@lo:400:kworker.0 00000100:00100000:0.0:1788918720.602625:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918720.602660:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865692160 00000100:00100000:0.0:1788918720.602668:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865692160 00000100:00100000:0.0:1788918720.602712:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788918720.602719:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:3417:x1875816865692160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918720.602762:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:3417:x1875816865692160:12345-0@lo:400:kworker.0 Request processed in 43us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918720.602769:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788918720.602797:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865692288 00000100:00100000:0.0:1788918720.602800:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865692288 00000100:00100000:0.0:1788918720.602821:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865692416 00000100:00100000:0.0:1788918720.602823:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865692416 00000100:00100000:0.0:1788918720.602851:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788918720.602856:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865692288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918720.602887:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865692288:12345-0@lo:400:kworker.0 Request processed in 30us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918720.602893:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788918720.602904:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788918720.602909:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865692416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918720.602941:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865692416:12345-0@lo:400:kworker.0 Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918720.602955:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788918720.602999:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffffaf5f80 x1875816865692416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918720.603012:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865692416:0@lo:400:kworker.0 00010000:00080000:0.0:1788918720.603062:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffffaf5c00 x1875816865692288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788918720.603069:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865692288:0@lo:400:kworker.0 00000100:00100000:0.0:1788918720.603077:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3417:1875816865692160:0@lo:400:kworker.0 00000100:00080000:2.0:1788918720.604495:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788918720.918725:0:15024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788918721.239295:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918722.265322:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788918722.744977:0:16138:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788918723.289974:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918723.353887:0:3416:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788918708/real 1788918708] req@ffff94ffefcb2a00 x1875816865688320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788918723 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918723.353917:0:3416:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94ffefcb2a00 x1875816865688320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788918723 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918723.353933:0:3416:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788918708/real 1788918708] req@ffff94ffefcb1c00 x1875816865688448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788918723 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918723.353945:0:3416:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94ffefcb1c00 x1875816865688448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788918723 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788918723.354004:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94fffc8e7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788918723.354043:0:3416:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788918723.354047:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865688320:0@lo:8:kworker.0 00000100:00080000:3.0:1788918723.354053:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94ffd0565800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788918723.354058:0:3416:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788918723.354061:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865688448:0@lo:8:kworker.0 00000100:00080000:3.0:1788918723.354135:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788918723.354139:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788918723.354141:0:37:0:(import.c:65:import_set_state_nolock()) ffff94fffc8e7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788918723.354145:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:3.0:1788918723.354151:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788918723.354157:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94fffc8e7000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788918723.354175:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffefcb2a00 x1875816865692672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788918723.354188:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788918723.354191:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788918723.354193:0:37:0:(import.c:65:import_set_state_nolock()) ffff94ffd0565800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788918723.354196:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:3.0:1788918723.354198:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788918723.354207:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94ffd0565800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788918723.354217:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffefcb1180 x1875816865692800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788918723.354257:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788918723.354267:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3419:1875816865692544:0@lo:400:kworker.0 00000100:00100000:3.0:1788918723.354328:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918723.354380:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865692928:0@lo:400:kworker.0 00000100:00100000:3.0:1788918723.354429:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918723.354448:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788918723.354453:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865693056:0@lo:400:kworker.0 00000100:00100000:3.0:1788918723.354472:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918723.354499:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865692544 00000100:00100000:3.0:1788918723.354506:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865692544 00000100:00100000:3.0:1788918723.354549:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788918723.354556:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:3419:x1875816865692544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918723.354595:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:3419:x1875816865692544:12345-0@lo:400:kworker.0 Request processed in 39us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918723.354602:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788918723.354628:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865692928 00000100:00100000:3.0:1788918723.354631:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865692928 00000100:00100000:3.0:1788918723.354650:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865693056 00000100:00100000:3.0:1788918723.354652:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865693056 00000100:00100000:3.0:1788918723.354678:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788918723.354683:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865692928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918723.354713:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865692928:12345-0@lo:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918723.354719:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788918723.354735:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788918723.354740:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865693056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918723.354762:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865693056:12345-0@lo:400:kworker.0 Request processed in 22us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918723.354767:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788918723.354800:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffefcb0700 x1875816865693056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918723.354812:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865693056:0@lo:400:kworker.0 00010000:00080000:3.0:1788918723.354821:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffefcb1880 x1875816865692928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918723.354828:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865692928:0@lo:400:kworker.0 00000100:00100000:3.0:1788918723.354846:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3419:1875816865692544:0@lo:400:kworker.0 00000100:00100000:3.0:1788918723.354857:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865692672:0@lo:8:kworker.0 00000100:00100000:3.0:1788918723.354878:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918723.354892:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865692800:0@lo:8:kworker.0 00000100:00100000:3.0:1788918723.354905:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918723.354932:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865692672 00000100:00100000:3.0:1788918723.354935:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865692672 00000100:00100000:3.0:1788918723.354947:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865692800 00000100:00100000:3.0:1788918723.354949:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865692800 00000100:00100000:3.0:1788918723.354957:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788918723.354961:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3416:x1875816865692672:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788918723.354984:0:15775:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:3.0:1788918723.355010:0:15775:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2811b8b2b0ac9ed9 00002000:00100000:3.0:1788918723.355058:0:15775:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff94ffff5e5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788918723.355062:0:15775:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788918723.355065:0:15775:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788918723.355235:0:15775:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788918723.355255:0:15775:0:(import.c:65:import_set_state_nolock()) ffff94ffff5e5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788918723.355288:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3416:x1875816865692672:12345-0@lo:8:kworker.0 Request processed in 326us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918723.355294:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788918723.355306:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788918723.355309:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3416:x1875816865692800:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788918723.355319:0:15775:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788918723.355337:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3416:x1875816865692800:12345-0@lo:8:kworker.0 Request processed in 27us (431us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788918723.355343:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788918723.355364:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffefcb2a00 x1875816865692672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788918743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918723.355373:0:3416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788918723.355378:0:3416:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788918723.355385:0:3416:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788918723.355389:0:3416:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788918723.355391:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94fffc8e7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788918723.355402:0:3416:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788918723.355406:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865692672:0@lo:8:kworker.0 00000100:00080000:3.0:1788918723.355413:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94ffd0565800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788918723.355416:0:3416:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788918723.355434:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865692800:0@lo:8:kworker.0 00000004:00080000:3.0:1788918723.355460:0:15012:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788918723.355518:0:15012:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 425636497075ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788918723.355523:0:15012:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:3.0:1788918723.361683:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788918723.362511:0:15013:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1788918723.362545:0:15013:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15013:1875816865693312:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788918723.362635:0:15013:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918723.362668:0:15013:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc5319e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788918723.362695:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865693312 00000100:00100000:2.0:1788918723.362703:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865693312 00000100:00100000:2.0:1788918723.362761:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788918723.362782:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:15013:x1875816865693312:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1788918723.363611:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918723.365670:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865693184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918723.365786:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918723.367653:0:15777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865693184 00000100:00100000:1.0:1788918723.367669:0:15777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865693184 00000100:00100000:1.0:1788918723.367726:0:15777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788918723.367736:0:15777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3419:x1875816865693184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788918723.367767:0:15777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923668992 avail 3692146688 00002000:00080000:2.0:1788918723.370647:0:15775:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788918723.370661:0:15775:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788918723.370667:0:15775:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:1.0:1788918723.383073:0:15777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3419:x1875816865693184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15329us (17279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918723.383089:0:15777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788918723.386486:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffffa8a300 x1875816865693184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918723.386524:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865693184:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788918723.386684:0:14970:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788918723.397000:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918723.397013:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9ee0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.397083:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788918723.397088:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918723.397097:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9ee0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.397119:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9ee0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.397130:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9ee0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.397138:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9ee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.397157:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788918723.397388:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918723.397395:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9ee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.397415:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc800 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918723.397434:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9ee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.397444:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9ee0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.397462:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9ee0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.397471:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9ee0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.397491:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918723.397493:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918723.397495:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788918723.398200:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918723.398208:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9ee7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.398220:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788918723.398225:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918723.398230:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.398242:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.398272:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.398281:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9ee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.398304:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.398565:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.398573:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9ee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.398580:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc000 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.398584:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9ee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.398593:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9ee7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.398608:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9ee7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.398616:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9ee7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.398639:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.398641:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.398643:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788918723.398850:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918723.398857:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9eee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.399005:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788918723.399010:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918723.399015:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9eee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.399054:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9eee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.399063:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9eee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.399070:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9eee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.399100:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.399375:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.399381:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9eee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.399390:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.399393:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9eee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.399402:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9eee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.399413:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9eee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.399441:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9eee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.399456:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.399459:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.399460:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788918723.399536:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918723.399543:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5538e95/0x2811b8b2b0ac9ef5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.399553:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788918723.399556:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918723.399560:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5538e95/0x2811b8b2b0ac9ef5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.399570:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5538e95/0x2811b8b2b0ac9ef5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.399578:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5538e95/0x2811b8b2b0ac9ef5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.399586:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5538e95/0x2811b8b2b0ac9ef5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.400510:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.408111:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.408125:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5538e95/0x2811b8b2b0ac9ef5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.408159:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.408165:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5538e95/0x2811b8b2b0ac9ef5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.408177:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5538e95/0x2811b8b2b0ac9ef5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788918723.408192:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918723.408200:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9865882/0x2811b8b2b0ac9efc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.408201:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5538e95/0x2811b8b2b0ac9ef5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.408209:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5538e95/0x2811b8b2b0ac9ef5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.408213:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788918723.408223:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918723.408227:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.408229:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.408230:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918723.408230:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9865882/0x2811b8b2b0ac9efc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.408242:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9865882/0x2811b8b2b0ac9efc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.408251:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9865882/0x2811b8b2b0ac9efc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.408258:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9865882/0x2811b8b2b0ac9efc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.408292:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.408533:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.408539:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9865882/0x2811b8b2b0ac9efc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.408545:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd600 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.408548:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9865882/0x2811b8b2b0ac9efc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.408556:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9865882/0x2811b8b2b0ac9efc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.408572:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9865882/0x2811b8b2b0ac9efc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.408579:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9865882/0x2811b8b2b0ac9efc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.408591:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.408593:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.408595:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788918723.408983:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918723.408990:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f51f2700/0x2811b8b2b0ac9f03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.409000:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788918723.409004:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918723.409008:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f51f2700/0x2811b8b2b0ac9f03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.409052:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f51f2700/0x2811b8b2b0ac9f03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.409061:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f51f2700/0x2811b8b2b0ac9f03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.409075:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f51f2700/0x2811b8b2b0ac9f03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.409091:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.409242:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.409247:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f51f2700/0x2811b8b2b0ac9f03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.409255:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.409259:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51f2700/0x2811b8b2b0ac9f03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.409273:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51f2700/0x2811b8b2b0ac9f03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.409285:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f51f2700/0x2811b8b2b0ac9f03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.409292:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f51f2700/0x2811b8b2b0ac9f03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.409319:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.409321:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.409322:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788918723.409557:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918723.409564:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed7cddf2/0x2811b8b2b0ac9f0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.409572:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788918723.409575:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918723.409579:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed7cddf2/0x2811b8b2b0ac9f0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.409588:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed7cddf2/0x2811b8b2b0ac9f0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.409597:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed7cddf2/0x2811b8b2b0ac9f0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.409604:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed7cddf2/0x2811b8b2b0ac9f0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.409624:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.409745:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.409751:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed7cddf2/0x2811b8b2b0ac9f0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.409759:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dca00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.409763:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed7cddf2/0x2811b8b2b0ac9f0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.409771:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed7cddf2/0x2811b8b2b0ac9f0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.409782:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed7cddf2/0x2811b8b2b0ac9f0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.409789:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed7cddf2/0x2811b8b2b0ac9f0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.409804:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.409806:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.409808:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788918723.410010:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918723.410017:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac9f11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.410064:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788918723.410067:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918723.410072:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac9f11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.410095:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac9f11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.410104:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac9f11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.410111:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac9f11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.410125:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.410258:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.410269:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac9f11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.410288:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48ddc00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.410292:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac9f11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.410302:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac9f11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.410313:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac9f11 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.410320:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d0bd0f3/0x2811b8b2b0ac9f11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.410333:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.410335:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.410336:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788918723.411880:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918723.411888:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9f18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.411900:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788918723.411903:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918723.411907:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9f18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.411916:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9f18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.411922:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9f18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.411927:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9f18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.411953:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.412470:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.412477:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9f18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.412486:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20c00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.412530:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9f18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.412540:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9f18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.412562:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9f18 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.412569:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084d14305/0x2811b8b2b0ac9f18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788918723.412578:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918723.412586:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9f1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.412587:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.412590:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.412593:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918723.412602:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788918723.412606:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918723.412610:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9f1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.412621:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9f1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.412629:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9f1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.412637:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9f1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.412657:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.412876:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.412881:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9f1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.412889:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21e00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.412892:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9f1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.412900:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9f1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.412911:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9f1f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.412917:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac944ce6/0x2811b8b2b0ac9f1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.412942:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.413011:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.413014:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788918723.413320:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918723.413327:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9f26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.413337:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788918723.413340:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918723.413344:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9f26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.413355:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9f26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.413376:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9f26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.413383:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9f26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.413406:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.413449:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.413455:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9f26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.413464:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc800 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.413468:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9f26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.413478:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9f26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.413490:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9f26 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.413498:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b045783/0x2811b8b2b0ac9f26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.413514:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.413516:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.413518:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788918723.414073:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918723.414080:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9f2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.414092:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788918723.414096:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918723.414100:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9f2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.414112:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9f2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.414120:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9f2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.414128:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9f2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.414159:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788918723.414613:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918723.414620:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9f34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.414630:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788918723.414633:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918723.414637:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9f34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.414646:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9f34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.414654:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9f34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.414660:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9f34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.414684:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788918723.415063:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918723.415070:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea68468e/0x2811b8b2b0ac9f3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415078:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788918723.415086:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918723.415091:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea68468e/0x2811b8b2b0ac9f3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415100:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea68468e/0x2811b8b2b0ac9f3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415107:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea68468e/0x2811b8b2b0ac9f3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415115:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea68468e/0x2811b8b2b0ac9f3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415123:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788918723.415316:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788918723.415322:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9f2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415331:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918723.415335:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9f2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415343:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9f2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415357:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9f2d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415376:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008dc0c33/0x2811b8b2b0ac9f2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415393:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788918723.415396:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9f34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415403:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc000 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918723.415406:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9f34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415413:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9f34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415433:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9f34 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415440:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbecc1b6/0x2811b8b2b0ac9f34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415449:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918723.415452:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea68468e/0x2811b8b2b0ac9f3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415458:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd000 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918723.415467:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea68468e/0x2811b8b2b0ac9f3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415475:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea68468e/0x2811b8b2b0ac9f3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415484:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea68468e/0x2811b8b2b0ac9f3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415491:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea68468e/0x2811b8b2b0ac9f3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918723.415504:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918723.415506:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918723.415508:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918723.415929:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788918723.417451:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788918723.417463:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016b0c893/0x2811b8b2b0ac9f42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.417480:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788918723.417485:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918723.417491:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016b0c893/0x2811b8b2b0ac9f42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.417507:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016b0c893/0x2811b8b2b0ac9f42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.417517:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016b0c893/0x2811b8b2b0ac9f42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.417523:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016b0c893/0x2811b8b2b0ac9f42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.417600:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.418681:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.418691:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016b0c893/0x2811b8b2b0ac9f42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.418716:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4c00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.418721:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016b0c893/0x2811b8b2b0ac9f42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.418731:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016b0c893/0x2811b8b2b0ac9f42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.418749:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016b0c893/0x2811b8b2b0ac9f42 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.418757:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016b0c893/0x2811b8b2b0ac9f42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.419407:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.419411:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.419414:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788918723.419840:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788918723.419849:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e653c30/0x2811b8b2b0ac9f49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.419863:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788918723.419867:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918723.419873:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e653c30/0x2811b8b2b0ac9f49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.419886:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e653c30/0x2811b8b2b0ac9f49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.419895:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e653c30/0x2811b8b2b0ac9f49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.419903:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e653c30/0x2811b8b2b0ac9f49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.419919:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788918723.420858:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788918723.420867:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000477282e2/0x2811b8b2b0ac9f50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.420880:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788918723.420891:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918723.420897:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000477282e2/0x2811b8b2b0ac9f50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.420909:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000477282e2/0x2811b8b2b0ac9f50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.420920:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000477282e2/0x2811b8b2b0ac9f50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.420928:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000477282e2/0x2811b8b2b0ac9f50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.420950:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788918723.421098:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788918723.421106:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e653c30/0x2811b8b2b0ac9f49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.421114:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4000 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.421119:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e653c30/0x2811b8b2b0ac9f49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.421131:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e653c30/0x2811b8b2b0ac9f49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.421371:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e653c30/0x2811b8b2b0ac9f49 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.421381:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e653c30/0x2811b8b2b0ac9f49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.421399:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.421403:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000477282e2/0x2811b8b2b0ac9f50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.421409:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.421412:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000477282e2/0x2811b8b2b0ac9f50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.421431:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000477282e2/0x2811b8b2b0ac9f50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.421442:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000477282e2/0x2811b8b2b0ac9f50 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.421449:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000477282e2/0x2811b8b2b0ac9f50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.421460:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.421462:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.421472:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788918723.421835:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788918723.421842:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d552d3e7/0x2811b8b2b0ac9f57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.421852:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788918723.421856:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918723.421861:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d552d3e7/0x2811b8b2b0ac9f57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.421871:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d552d3e7/0x2811b8b2b0ac9f57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.421880:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d552d3e7/0x2811b8b2b0ac9f57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.421894:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d552d3e7/0x2811b8b2b0ac9f57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.421947:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.422567:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.422576:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d552d3e7/0x2811b8b2b0ac9f57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.422593:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.422597:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d552d3e7/0x2811b8b2b0ac9f57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.422606:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d552d3e7/0x2811b8b2b0ac9f57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.422621:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d552d3e7/0x2811b8b2b0ac9f57 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.422628:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d552d3e7/0x2811b8b2b0ac9f57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.422645:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.422647:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.422649:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918723.422744:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788918723.423646:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918723.423656:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac9f5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.423670:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788918723.423681:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918723.423687:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac9f5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.423699:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac9f5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.423707:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac9f5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.423714:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac9f5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.423732:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.423761:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.423768:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac9f5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.423778:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21000 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.423783:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac9f5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.423910:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac9f5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.423926:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac9f5e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.423935:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e46dbcc/0x2811b8b2b0ac9f5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.423953:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.423955:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.423957:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788918723.424202:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918723.424208:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004ee817f/0x2811b8b2b0ac9f65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.424216:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788918723.424219:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918723.424223:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004ee817f/0x2811b8b2b0ac9f65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.424233:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004ee817f/0x2811b8b2b0ac9f65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.424242:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004ee817f/0x2811b8b2b0ac9f65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.424257:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004ee817f/0x2811b8b2b0ac9f65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.424281:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788918723.424411:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918723.424427:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004ee817f/0x2811b8b2b0ac9f65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.424435:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20a00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918723.424439:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004ee817f/0x2811b8b2b0ac9f65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.424448:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004ee817f/0x2811b8b2b0ac9f65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.424462:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004ee817f/0x2811b8b2b0ac9f65 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.424469:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004ee817f/0x2811b8b2b0ac9f65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.424484:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918723.424486:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918723.424487:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788918723.424718:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918723.424723:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7237/0x2811b8b2b0ac9f6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.424731:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788918723.424734:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918723.424738:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7237/0x2811b8b2b0ac9f6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.424747:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7237/0x2811b8b2b0ac9f6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.424754:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7237/0x2811b8b2b0ac9f6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.424761:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7237/0x2811b8b2b0ac9f6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.424777:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.424802:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.424810:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7237/0x2811b8b2b0ac9f6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.424819:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.424823:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7237/0x2811b8b2b0ac9f6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.424831:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7237/0x2811b8b2b0ac9f6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.424843:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7237/0x2811b8b2b0ac9f6c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.424863:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2aa7237/0x2811b8b2b0ac9f6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.424877:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.424879:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.424881:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788918723.425153:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918723.425159:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9f73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.425173:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788918723.425176:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918723.425180:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9f73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.425189:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9f73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.425198:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9f73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.425207:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9f73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.425225:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788918723.425364:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918723.425374:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9f73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.425381:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918723.425385:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9f73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.425393:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9f73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.425404:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9f73 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.425411:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000760d03f3/0x2811b8b2b0ac9f73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.425438:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918723.425439:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918723.425441:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788918723.425678:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918723.425683:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eec5310/0x2811b8b2b0ac9f7a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.425691:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1788918723.425693:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918723.425697:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eec5310/0x2811b8b2b0ac9f7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.425706:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eec5310/0x2811b8b2b0ac9f7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.425725:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eec5310/0x2811b8b2b0ac9f7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.425732:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eec5310/0x2811b8b2b0ac9f7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918723.425749:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.425773:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.425780:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eec5310/0x2811b8b2b0ac9f7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.425789:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20e00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.425793:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eec5310/0x2811b8b2b0ac9f7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.425802:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eec5310/0x2811b8b2b0ac9f7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.425814:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eec5310/0x2811b8b2b0ac9f7a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.425822:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eec5310/0x2811b8b2b0ac9f7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.425837:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.425839:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.425841:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788918723.427784:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788918723.427794:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d13b22ce/0x2811b8b2b0ac9f81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.427808:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788918723.427812:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918723.427817:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d13b22ce/0x2811b8b2b0ac9f81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.427843:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d13b22ce/0x2811b8b2b0ac9f81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.427853:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d13b22ce/0x2811b8b2b0ac9f81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.427861:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d13b22ce/0x2811b8b2b0ac9f81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.427892:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.427913:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.427922:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d13b22ce/0x2811b8b2b0ac9f81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.427932:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4a00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.427937:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d13b22ce/0x2811b8b2b0ac9f81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.427946:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d13b22ce/0x2811b8b2b0ac9f81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.427963:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d13b22ce/0x2811b8b2b0ac9f81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.428076:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d13b22ce/0x2811b8b2b0ac9f81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.428098:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.428100:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.428101:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788918723.428324:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788918723.428330:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8d4ca1c/0x2811b8b2b0ac9f88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.428339:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788918723.428343:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918723.428347:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8d4ca1c/0x2811b8b2b0ac9f88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.428357:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8d4ca1c/0x2811b8b2b0ac9f88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.428365:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8d4ca1c/0x2811b8b2b0ac9f88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.428385:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8d4ca1c/0x2811b8b2b0ac9f88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.428405:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.428542:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.428550:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8d4ca1c/0x2811b8b2b0ac9f88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.428557:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4e00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.428560:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8d4ca1c/0x2811b8b2b0ac9f88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.428577:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8d4ca1c/0x2811b8b2b0ac9f88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.428601:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8d4ca1c/0x2811b8b2b0ac9f88 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.428609:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8d4ca1c/0x2811b8b2b0ac9f88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.428623:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.428625:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.428627:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788918723.428878:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788918723.428884:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc40909b/0x2811b8b2b0ac9f8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.428893:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788918723.428896:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918723.428900:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc40909b/0x2811b8b2b0ac9f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.428910:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc40909b/0x2811b8b2b0ac9f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.428918:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc40909b/0x2811b8b2b0ac9f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.428924:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc40909b/0x2811b8b2b0ac9f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.428943:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.429111:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.429117:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc40909b/0x2811b8b2b0ac9f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.429124:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4600 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.429128:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc40909b/0x2811b8b2b0ac9f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.429135:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc40909b/0x2811b8b2b0ac9f8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.429145:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc40909b/0x2811b8b2b0ac9f8f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.429163:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc40909b/0x2811b8b2b0ac9f8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.429176:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.429178:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.429179:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788918723.429458:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788918723.429464:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255a6740/0x2811b8b2b0ac9f96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.429477:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788918723.429480:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918723.429485:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255a6740/0x2811b8b2b0ac9f96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.429494:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255a6740/0x2811b8b2b0ac9f96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.429502:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255a6740/0x2811b8b2b0ac9f96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.429510:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000255a6740/0x2811b8b2b0ac9f96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.429529:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918723.429647:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.429653:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000255a6740/0x2811b8b2b0ac9f96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.429660:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.429663:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000255a6740/0x2811b8b2b0ac9f96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.429670:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000255a6740/0x2811b8b2b0ac9f96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.429681:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000255a6740/0x2811b8b2b0ac9f96 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.429687:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255a6740/0x2811b8b2b0ac9f96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.429699:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.429700:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.429702:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788918723.430148:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788918723.430155:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b861f99/0x2811b8b2b0ac9f9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.430164:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788918723.430173:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918723.430177:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b861f99/0x2811b8b2b0ac9f9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.430187:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b861f99/0x2811b8b2b0ac9f9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.430205:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b861f99/0x2811b8b2b0ac9f9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.430212:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b861f99/0x2811b8b2b0ac9f9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918723.430227:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788918723.430263:0:15775:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1788918723.430356:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:15013:x1875816865693312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 67574us (67719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918723.430370:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788918723.430556:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918723.430562:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b861f99/0x2811b8b2b0ac9f9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.430570:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4800 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918723.430574:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b861f99/0x2811b8b2b0ac9f9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.430583:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b861f99/0x2811b8b2b0ac9f9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.430606:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b861f99/0x2811b8b2b0ac9f9d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.430613:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b861f99/0x2811b8b2b0ac9f9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918723.430629:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.430630:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918723.430632:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918723.431448:0:15013:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15013:1875816865693312:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788918723.431466:0:15013:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1788918723.431508:0:15013:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15013:1875816865693440:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788918723.431548:0:15013:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918723.431595:0:15013:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbdc5000 going to sleep for 11 seconds 00000100:00100000:3.0:1788918723.431675:0:15773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865693440 00000100:00100000:3.0:1788918723.431683:0:15773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865693440 00000100:00100000:3.0:1788918723.431770:0:15773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788918723.431780:0:15773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:15013:x1875816865693440:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788918723.431821:0:15773:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000001:00080000:3.0:1788918723.437688:0:15770:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788918723.437732:0:15770:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788918723.438181:0:15773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:15013:x1875816865693440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6398us (6627us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788918723.438196:0:15773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788918723.438408:0:15013:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788918723.438443:0:15013:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:15013:1875816865693440:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788918723.438459:0:15013:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000020:00000004:2.0:1788918723.938837:0:16190:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788918723.939240:0:16190:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788918724.311712:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788918724.981452:0:16240:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788918724.981890:0:16240:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788918725.342593:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918726.359257:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918727.383728:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918728.407162:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918728.791249:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865693568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918728.791321:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918728.791445:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865693568 00000100:00100000:1.0:1788918728.791454:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865693568 00000100:00100000:1.0:1788918728.791524:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788918728.791535:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865693568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788918728.791564:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918728.791609:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865693568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918728.791616:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788918728.791687:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918728.791722:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865693568:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788918728.791872:0:14398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788918728.791877:0:14398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788918728.791881:0:14398:0:(import.c:65:import_set_state_nolock()) ffff94ffd0565800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788918728.791887:0:14398:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:0.0:1788918728.791892:0:14398:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788918728.791897:0:14398:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94ffd0565800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:0.0:1788918728.791919:0:14398:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffffaf5c00 x1875816865693824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788918728.791988:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3417:1875816865693696:0@lo:400:kworker.0 00000100:00100000:3.0:1788918728.792064:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918728.792093:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788918728.792099:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865693952:0@lo:400:kworker.0 00000100:00100000:3.0:1788918728.792125:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918728.792151:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865693824:0@lo:8:kworker.0 00000100:00100000:3.0:1788918728.792173:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918728.792199:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865693952 00000100:00100000:3.0:1788918728.792204:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865693952 00000100:00100000:3.0:1788918728.792234:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788918728.792241:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865693952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918728.792278:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865693952:12345-0@lo:400:kworker.0 Request processed in 37us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918728.792285:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788918728.792306:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865694080:0@lo:400:kworker.0 00000100:00100000:3.0:1788918728.792330:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918728.792354:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865694080 00000100:00100000:3.0:1788918728.792383:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865694080 00000100:00100000:3.0:1788918728.792413:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788918728.792418:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865694080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918728.792451:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865694080:12345-0@lo:400:kworker.0 Request processed in 33us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918728.792457:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788918728.792470:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788918728.792489:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffffaf7800 x1875816865694080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918728.792501:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865694080:0@lo:400:kworker.0 00010000:00080000:3.0:1788918728.792523:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffffaf5f80 x1875816865693952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918728.792530:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865693952:0@lo:400:kworker.0 00000100:00100000:1.0:1788918728.792857:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865693824 00000100:00100000:1.0:1788918728.792863:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865693824 00000100:00100000:1.0:1788918728.792894:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788918728.792899:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3416:x1875816865693824:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788918728.792916:0:15775:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788918728.811467:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865693696 00000100:00100000:0.0:1788918728.811485:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865693696 00000100:00100000:0.0:1788918728.811565:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788918728.811576:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:3417:x1875816865693696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918728.811668:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:3417:x1875816865693696:12345-0@lo:400:kworker.0 Request processed in 95us (19603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918728.811693:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788918728.811760:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3417:1875816865693696:0@lo:400:kworker.0 00000100:00100000:1.0:1788918728.845677:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3416:x1875816865693824:12345-0@lo:8:kworker.0 Request processed in 52768us (53494us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788918728.845691:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788918728.849775:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94ffd0565800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788918728.849790:0:3416:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788918728.849796:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865693824:0@lo:8:kworker.0 00010000:00010000:3.0:1788918729.430318:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788918730.142180:0:15024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788918730.454980:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918731.478262:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918732.510830:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788918733.472282:0:16586:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788918733.472287:0:16586:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788918733.472289:0:16586:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788918733.472409:0:16586:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94ffe8da4000 00000020:01000004:2.0:1788918733.472426:0:16586:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788918733.472440:0:16586:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788918733.472456:0:16586:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff94fffca3b380) 00000020:00000080:2.0:1788918733.472475:0:16586:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1788918733.529840:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788918733.550263:0:16586:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788918733.552393:0:16586:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788918733.553122:0:16586:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788918733.553441:0:16586:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788918733.555271:0:16586:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788918733.558126:0:16586:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788918733.560556:0:16586:0:(osd_scrub.c:1811:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1788918733.570731:0:16586:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788918733.571140:0:16586:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788918733.571156:0:16586:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788918733.571179:0:16586:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2811b8b2b0ac9fab 00000020:01000004:3.0:1788918733.571188:0:16586:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788918733.571213:0:16586:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.149@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788918733.571222:0:16586:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788918733.571229:0:16586:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788918733.571261:0:16586:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788918733.571266:0:16586:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.149@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788918733.586713:0:16586:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788918733.586759:0:16586:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.149@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788918733.586763:0:16586:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788918733.586765:0:16586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788918733.586766:0:16586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788918733.586767:0:16586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788918733.586769:0:16586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788918733.586770:0:16586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788918733.586771:0:16586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788918733.586773:0:16586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788918733.586774:0:16586:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788918733.586777:0:16586:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788918733.586779:0:16586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788918733.586781:0:16586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788918733.586782:0:16586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788918733.586783:0:16586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788918733.586784:0:16586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788918733.586785:0:16586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788918733.586786:0:16586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788918733.586787:0:16586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788918733.586788:0:16586:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788918733.586813:0:16586:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788918733.586833:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694208:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788918733.586904:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918733.587066:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788918733.588653:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865694208 00000100:00100000:0.0:1788918733.588674:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865694208 00000100:00100000:0.0:1788918733.588739:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788918733.588750:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:16586:x1875816865694208:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788918733.588785:0:14985:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788918733.588788:0:14985:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788918733.588792:0:14985:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788918733.589572:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:16586:x1875816865694208:12345-0@lo:253:mount.lustre.0 Request processed in 820us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918733.589581:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788918733.589645:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694208:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788918733.589661:0:16586:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788918733.589664:0:16586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788918733.589666:0:16586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788918733.589667:0:16586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788918733.589668:0:16586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788918733.589683:0:16586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788918733.589685:0:16586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788918733.589686:0:16586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788918733.589688:0:16586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788918733.589689:0:16586:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788918733.589712:0:16586:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94ffe8da4000 from lustre-OST0001 10000000:01000000:3.0:1788918733.589741:0:16586:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788918733.589745:0:16586:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788918733.589752:0:16586:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94ffe8dbcd40 local copy 00010000:00010000:3.0:1788918733.589762:0:16586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dc600/0x2811b8b2b0ac9d51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d58 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918733.589851:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788918733.589879:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918733.589910:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99000 going to sleep for 11 seconds 00000100:00100000:0.0:1788918733.589923:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865694336 00000100:00100000:0.0:1788918733.589927:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865694336 00000100:00100000:0.0:1788918733.589964:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788918733.589972:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:16586:x1875816865694336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788918733.590132:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:16586:x1875816865694336:12345-0@lo:501:mount.lustre.0 Request processed in 160us (251us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788918733.590140:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788918733.590155:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694336:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788918733.590169:0:16586:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788918733.590185:0:16586:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788918733.590191:0:16586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff48dc600/0x2811b8b2b0ac9d51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d58 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918733.590199:0:16586:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fff48dc600/0x2811b8b2b0ac9d51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9d58 expref: -99 pid: 14969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918733.590220:0:16586:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94ffe8da4000 10000000:01000000:3.0:1788918733.590224:0:16586:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788918733.590229:0:16586:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788918733.590232:0:16586:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788918733.590235:0:16586:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788918733.590238:0:16586:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788918733.590258:0:16586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac9fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918733.590274:0:16586:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac9fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918733.590283:0:16586:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac9fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918733.590308:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788918733.590343:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918733.590368:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99000 going to sleep for 11 seconds 00000100:00100000:0.0:1788918733.590479:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865694464 00000100:00100000:0.0:1788918733.590483:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865694464 00000100:00100000:0.0:1788918733.590514:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788918733.590521:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:16586:x1875816865694464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788918733.590529:0:14983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918733.590541:0:14983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcb20200/0x2811b8b2b0ac9fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9fb2 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918733.590627:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcb20200/0x2811b8b2b0ac9fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9fb2 expref: 17 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918733.590637:0:14983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcb20200/0x2811b8b2b0ac9fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9fb2 expref: 17 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918733.590646:0:14983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20200, rc 0) 00000100:00100000:0.0:1788918733.590753:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:16586:x1875816865694464:12345-0@lo:101:mount.lustre.0 Request processed in 232us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918733.590760:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788918733.591086:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788918733.591100:0:16586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac9fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9fb9 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918733.591107:0:16586:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac9fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9fb9 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788918733.595922:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788918733.597046:0:16586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788918733.599348:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788918733.599410:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788918733.599429:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788918733.599446:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788918733.599461:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788918733.599476:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788918733.599503:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788918733.599509:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788918733.599617:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788918733.599690:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918733.599843:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbdc5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788918733.603905:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865694592 00000100:00100000:1.0:1788918733.603922:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865694592 00000100:00100000:1.0:1788918733.604005:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788918733.604015:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:16586:x1875816865694592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788918733.604557:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:16586:x1875816865694592:12345-0@lo:501:mount.lustre.0 Request processed in 532us (4855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918733.604565:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788918733.604741:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788918733.604791:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788918733.604847:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918733.604886:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99300 going to sleep for 11 seconds 00000100:00100000:0.0:1788918733.604940:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865694720 00000100:00100000:0.0:1788918733.604946:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865694720 00000100:00100000:0.0:1788918733.604990:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788918733.604998:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:16586:x1875816865694720:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788918733.605887:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:16586:x1875816865694720:12345-0@lo:503:mount.lustre.0 Request processed in 887us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918733.605896:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788918733.605990:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694720:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788918733.606630:0:16586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788918733.606718:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788918733.606765:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918733.606915:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99000 going to sleep for 11 seconds 00000100:00100000:1.0:1788918733.608236:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865694848 00000100:00100000:1.0:1788918733.608250:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865694848 00000100:00100000:0.0:1788918733.608651:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788918733.608663:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:16586:x1875816865694848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788918733.609272:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:16586:x1875816865694848:12345-0@lo:502:mount.lustre.0 Request processed in 609us (2504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918733.609281:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788918733.609475:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788918733.609718:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788918733.609749:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788918733.609764:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788918733.609787:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788918733.609801:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788918733.609815:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788918733.609829:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788918733.609844:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788918733.609857:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788918733.609893:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788918733.609946:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918733.613472:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbdc5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918733.615105:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865694976 00000100:00100000:0.0:1788918733.615122:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865694976 00000100:00100000:0.0:1788918733.615230:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788918733.615243:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:16586:x1875816865694976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788918733.616428:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:16586:x1875816865694976:12345-0@lo:502:mount.lustre.0 Request processed in 1185us (6478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918733.616437:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788918733.617545:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865694976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788918733.617657:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788918733.617672:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788918733.618727:0:16590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788918733.618736:0:16590:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788918733.618743:0:16590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788918733.618745:0:16590:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788918733.618752:0:16590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788918733.618768:0:16590:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff94fffbddcd40) 00000020:00000080:1.0:1788918733.618793:0:16590:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788918733.618799:0:16590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788918733.618887:0:16590:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94ffe8da4000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788918733.618895:0:16590:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788918733.618903:0:16590:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2811b8b2b0ac9fc7 00010000:00010000:1.0:1788918733.627636:0:16590:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788918733.629386:0:16590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788918733.631933:0:16590:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788918733.637494:0:16590:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788918733.637506:0:16590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788918733.637513:0:16590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918733.637515:0:16590:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788918733.637519:0:16590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788918733.637522:0:16590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918733.637523:0:16590:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788918733.637526:0:16590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788918733.637528:0:16590:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788918733.637530:0:16590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788918733.637531:0:16590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918733.637532:0:16590:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788918733.637534:0:16590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788918733.637537:0:16590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918733.637538:0:16590:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788918733.637541:0:16590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788918733.637593:0:16590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788918733.637596:0:16590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788918733.637597:0:16590:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788918733.637601:0:16590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788918733.640303:0:16586:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788918733.640359:0:16586:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788918733.640386:0:16586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac9fb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9fb9 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918733.640398:0:16586:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc0031c00/0x2811b8b2b0ac9fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9fb9 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788918733.640406:0:16586:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94ffe8da4000 from 1 10000000:01000000:3.0:1788918733.640408:0:16586:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788918733.640448:0:16586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918733.640456:0:16586:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918733.640466:0:16586:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918733.640490:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695104:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788918733.640753:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918733.640791:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788918733.640978:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865695104 00000100:00100000:1.0:1788918733.640986:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865695104 00000100:00100000:1.0:1788918733.641059:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788918733.641069:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:16586:x1875816865695104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788918733.641082:0:14982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918733.641096:0:14982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcbc5200/0x2811b8b2b0ac9fd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9fce expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.641120:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcbc5200/0x2811b8b2b0ac9fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9fce expref: 18 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.641131:0:14982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcbc5200/0x2811b8b2b0ac9fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9fce expref: 18 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.641140:0:14982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5200, rc 0) 00000100:00100000:1.0:1788918733.641410:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:16586:x1875816865695104:12345-0@lo:101:mount.lustre.0 Request processed in 342us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918733.641417:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788918733.642678:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695104:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788918733.642701:0:16586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9fd5 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918733.642713:0:16586:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9fd5 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788918733.645236:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788918733.646470:0:16586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788918733.648146:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788918733.648411:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788918733.648439:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788918733.648445:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788918733.648563:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788918733.648631:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918733.648728:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788918733.650239:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865695232 00000100:00100000:0.0:1788918733.650251:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865695232 00000100:00100000:0.0:1788918733.650406:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788918733.650418:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:16586:x1875816865695232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788918733.651093:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:16586:x1875816865695232:12345-0@lo:501:mount.lustre.0 Request processed in 674us (2457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918733.651104:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788918733.656182:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788918733.656582:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788918733.656672:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918733.656719:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865695360 00000100:00100000:1.0:1788918733.656725:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865695360 00000100:00100000:1.0:1788918733.656779:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788918733.656788:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:16586:x1875816865695360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788918733.656893:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:16586:x1875816865695360:12345-0@lo:503:mount.lustre.0 Request processed in 105us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918733.656907:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788918733.656956:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc7044240 going to sleep for 11 seconds 00000100:00100000:1.0:1788918733.658125:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788918733.658765:0:16586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788918733.658878:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788918733.658943:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918733.660161:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc7044240 going to sleep for 11 seconds 00000100:00100000:0.0:1788918733.663406:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865695488 00000100:00100000:0.0:1788918733.663423:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865695488 00000100:00100000:0.0:1788918733.663531:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788918733.663543:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:16586:x1875816865695488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788918733.663736:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:16586:x1875816865695488:12345-0@lo:502:mount.lustre.0 Request processed in 195us (4792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918733.663744:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788918733.664318:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff845180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788918733.664589:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788918733.664625:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788918733.664641:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788918733.664656:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788918733.664671:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788918733.664684:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788918733.664697:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788918733.664709:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788918733.664751:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788918733.664820:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918733.664864:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918733.666477:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865695616 00000100:00100000:2.0:1788918733.666492:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865695616 00000100:00100000:2.0:1788918733.666544:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788918733.666554:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:16586:x1875816865695616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788918733.666720:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:16586:x1875816865695616:12345-0@lo:502:mount.lustre.0 Request processed in 167us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918733.666728:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788918733.667261:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788918733.667499:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788918733.667514:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788918733.668620:0:16594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788918733.668632:0:16594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918733.668634:0:16594:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788918733.668647:0:16594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94ffe8da4000 00000020:00000080:3.0:1788918733.668650:0:16594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788918733.668658:0:16594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918733.668660:0:16594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918733.668661:0:16594:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788918733.668664:0:16594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788918733.668666:0:16594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918733.668668:0:16594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788918733.668670:0:16594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94ffe8da4000 00000020:00000080:3.0:1788918733.668672:0:16594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788918733.668732:0:16594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918733.668736:0:16594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918733.668737:0:16594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788918733.668740:0:16594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788918733.668742:0:16594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918733.668743:0:16594:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788918733.668747:0:16594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94ffe8da4000 00000020:00000080:3.0:1788918733.668749:0:16594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788918733.668774:0:16594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788918733.668777:0:16594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788918733.668779:0:16594:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788918733.668781:0:16594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788918733.676663:0:16586:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788918733.676712:0:16586:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788918733.677106:0:16586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9fd5 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918733.677119:0:16586:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9fd5 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918733.677189:0:16586:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788918733.677192:0:16586:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94ffe8da4000 10000000:01000000:0.0:1788918733.677195:0:16586:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94ffe8da4000 10000000:01000000:0.0:1788918733.677199:0:16586:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788918733.677204:0:16586:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94ffe8da4000 from 1 10000000:01000000:0.0:1788918733.677207:0:16586:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788918733.677243:0:16586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcb21000/0x2811b8b2b0ac9fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918733.677252:0:16586:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fffcb21000/0x2811b8b2b0ac9fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918733.677263:0:16586:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fffcb21000/0x2811b8b2b0ac9fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918733.677297:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788918733.677375:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918733.677416:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc723b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788918733.677501:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865695744 00000100:00100000:2.0:1788918733.677511:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865695744 00000100:00100000:2.0:1788918733.677567:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788918733.677577:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:16586:x1875816865695744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788918733.677589:0:14982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918733.677602:0:14982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff48dc000/0x2811b8b2b0ac9fe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0ac9fdc expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918733.677627:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dc000/0x2811b8b2b0ac9fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9fdc expref: 19 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918733.677638:0:14982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff48dc000/0x2811b8b2b0ac9fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9fdc expref: 19 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918733.677656:0:14982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dc000, rc 0) 00000100:00100000:2.0:1788918733.677700:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:16586:x1875816865695744:12345-0@lo:101:mount.lustre.0 Request processed in 125us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918733.677706:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788918733.678408:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788918733.678427:0:16586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fffcb21000/0x2811b8b2b0ac9fdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9fe3 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918733.678437:0:16586:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fffcb21000/0x2811b8b2b0ac9fdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0ac9fe3 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788918733.679404:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788918733.679631:0:16586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788918733.679776:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788918733.679802:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788918733.679813:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788918733.679836:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788918733.679848:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788918733.679858:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788918733.679869:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788918733.679879:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788918733.679890:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788918733.679900:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788918733.679911:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788918733.679921:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788918733.679931:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788918733.679941:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788918733.679952:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788918733.679962:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788918733.679972:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788918733.679982:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788918733.679992:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788918733.680011:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788918733.680049:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788918733.680061:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788918733.680071:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788918733.680082:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788918733.680092:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788918733.680103:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788918733.680113:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788918733.680123:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788918733.680134:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788918733.680144:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788918733.680154:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788918733.680179:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788918733.680192:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788918733.680202:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788918733.680221:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788918733.680241:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788918733.680253:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788918733.680267:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788918733.680271:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788918733.681657:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788918733.681728:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918733.682138:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc62a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788918733.682272:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865695872 00000100:00100000:0.0:1788918733.682281:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865695872 00000100:00100000:0.0:1788918733.682470:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788918733.682482:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:16586:x1875816865695872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788918733.682636:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:16586:x1875816865695872:12345-0@lo:501:mount.lustre.0 Request processed in 156us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918733.682645:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788918733.682727:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865695872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788918733.682768:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865696000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788918733.682814:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918733.682905:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc62a1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788918733.682955:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865696000 00000100:00100000:2.0:1788918733.682961:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865696000 00000100:00100000:2.0:1788918733.682986:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788918733.682994:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc395e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:16586:x1875816865696000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788918733.683102:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc395e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:16586:x1875816865696000:12345-0@lo:503:mount.lustre.0 Request processed in 108us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918733.683109:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788918733.683413:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865696000:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788918733.683852:0:16586:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788918733.683920:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865696128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788918733.683966:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918733.684067:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc531d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788918733.690601:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865696128 00000100:00100000:2.0:1788918733.690617:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865696128 00000100:00100000:2.0:1788918733.690692:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788918733.690704:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc395c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:16586:x1875816865696128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788918733.690885:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc395c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:16586:x1875816865696128:12345-0@lo:502:mount.lustre.0 Request processed in 183us (6918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918733.690894:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788918733.691078:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865696128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788918733.691535:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788918733.691569:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788918733.691585:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788918733.691602:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788918733.691617:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788918733.691633:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788918733.691647:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788918733.691660:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788918733.691671:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788918733.691695:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788918733.691711:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788918733.691724:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788918733.691754:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788918733.691771:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788918733.691782:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788918733.691792:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788918733.691803:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788918733.691815:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788918733.691826:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788918733.691838:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788918733.691850:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788918733.691862:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788918733.691873:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788918733.691886:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788918733.691898:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788918733.691911:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788918733.691924:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788918733.691936:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788918733.691961:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788918733.691977:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788918733.691988:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788918733.692000:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788918733.692014:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788918733.693151:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788918733.693399:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788918733.693416:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788918733.693428:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788918733.693440:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788918733.693453:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788918733.693465:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788918733.693509:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865696256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788918733.693595:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918733.693689:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc62a1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788918733.696913:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865696256 00000100:00100000:1.0:1788918733.696929:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865696256 00000100:00100000:1.0:1788918733.696982:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788918733.696993:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe08bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:16586:x1875816865696256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788918733.697310:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe08bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:16586:x1875816865696256:12345-0@lo:502:mount.lustre.0 Request processed in 317us (3714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918733.697319:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788918733.699536:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865696256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788918733.699645:0:16586:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788918733.699661:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788918733.706539:0:16599:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788918733.706558:0:16599:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff94fffca399c0) 00000020:00000080:2.0:1788918733.706579:0:16599:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788918733.706668:0:16599:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94ffe8da4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788918733.706673:0:16599:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94ffe8da4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788918733.706675:0:16599:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94ffe8da4000 3 00010000:00080000:2.0:1788918733.706709:0:16599:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94fffc540800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.149@tcp at head 00010000:00010000:3.0:1788918733.711900:0:16599:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788918733.712267:0:16599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788918733.712486:0:16599:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788918733.712501:0:16599:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2811b8b2b0ac9ff1 00000100:00080000:3.0:1788918733.712512:0:16599:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788918733.712519:0:16599:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94fffc540800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788918733.712557:0:16599:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffefcb1f80 x1875816865696384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788918733.712587:0:16599:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788918733.712760:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3416:1875816865696384:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788918733.712835:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788918733.712999:0:14398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788918733.713011:0:14398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788918733.713014:0:14398:0:(import.c:65:import_set_state_nolock()) ffff94ffd0565800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788918733.713040:0:14398:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:2.0:1788918733.713043:0:14398:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788918733.713048:0:14398:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94ffd0565800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788918733.713063:0:14398:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffffa89c00 x1875816865696640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788918733.713112:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788918733.713120:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865696512:0@lo:400:kworker.0 00000100:00100000:2.0:1788918733.713154:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918733.713202:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865696640:0@lo:8:kworker.0 00000100:00100000:2.0:1788918733.713225:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918733.713253:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865696768:0@lo:400:kworker.0 00000100:00100000:2.0:1788918733.713277:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918733.713445:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788918733.713451:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865696896:0@lo:400:kworker.0 00000100:00100000:2.0:1788918733.713480:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918733.713520:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865696512 00000100:00100000:2.0:1788918733.713527:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865696512 00000100:00100000:2.0:1788918733.713569:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865696640 00000100:00100000:2.0:1788918733.713573:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865696640 00000100:00100000:2.0:1788918733.713585:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788918733.713595:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865696512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918733.713644:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865696512:12345-0@lo:400:kworker.0 Request processed in 51us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918733.713651:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788918733.713675:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788918733.713680:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3416:x1875816865696640:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788918733.713735:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3416:x1875816865696640:12345-0@lo:8:kworker.0 Request processed in 53us (508us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788918733.713742:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788918733.713760:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865696384 00000100:00100000:2.0:1788918733.713763:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865696384 00000100:00100000:2.0:1788918733.713776:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865696768 00000100:00100000:2.0:1788918733.713779:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865696768 00000100:00100000:2.0:1788918733.713791:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865696896 00000100:00100000:2.0:1788918733.713794:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865696896 00000100:00100000:2.0:1788918733.713809:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788918733.713815:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865696768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918733.713850:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865696768:12345-0@lo:400:kworker.0 Request processed in 35us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918733.713857:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788918733.713867:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788918733.713873:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865696896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918733.713899:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865696896:12345-0@lo:400:kworker.0 Request processed in 26us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918733.713905:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788918733.713916:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788918733.713919:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3416:x1875816865696384:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788918733.713935:0:14992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:2.0:1788918733.713975:0:14992:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2811b8b2b0ac9ff8 00000004:00100000:2.0:1788918733.713995:0:14992:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788918733.714050:0:14992:0:(import.c:65:import_set_state_nolock()) ffff94fffc547000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788918733.714090:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3416:x1875816865696384:12345-0@lo:38:llog_process_th.0 Request processed in 169us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918733.714097:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788918733.714119:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788918733.714123:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788918733.714149:0:3416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788918733.714156:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94ffd0565800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788918733.714159:0:3416:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788918733.714395:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865696640:0@lo:8:kworker.0 00010000:00080000:2.0:1788918733.714427:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffefcb1f80 x1875816865696384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788918743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918733.714437:0:3416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788918733.714442:0:3416:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788918733.714449:0:3416:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788918733.714453:0:3416:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788918733.714456:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94fffc540800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788918733.714461:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3416:1875816865696384:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788918733.714501:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865696512:0@lo:400:kworker.0 00010000:00080000:2.0:1788918733.714523:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffffa8b480 x1875816865696896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918733.714532:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865696896:0@lo:400:kworker.0 00010000:00080000:2.0:1788918733.714541:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94ffffa88e00 x1875816865696768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788918733.714549:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865696768:0@lo:400:kworker.0 00000040:00080000:3.0:1788918733.714742:0:16599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788918733.714887:0:16586:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788918733.714914:0:16586:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788918733.715057:0:16586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcb21000/0x2811b8b2b0ac9fdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9fe3 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918733.715070:0:16586:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fffcb21000/0x2811b8b2b0ac9fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0ac9fe3 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788918733.715120:0:16586:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788918733.715122:0:16586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788918733.715123:0:16586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788918733.715124:0:16586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788918733.715125:0:16586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788918733.715127:0:16586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788918733.715128:0:16586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788918733.715129:0:16586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788918733.715130:0:16586:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788918733.715134:0:16586:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788918733.715136:0:16586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788918733.715137:0:16586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788918733.715138:0:16586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788918733.715140:0:16586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788918733.715141:0:16586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788918733.715142:0:16586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788918733.715143:0:16586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788918733.715144:0:16586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788918733.715145:0:16586:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788918733.715174:0:16586:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788918733.715189:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865697024:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788918733.715231:0:16586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918733.715274:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbd8ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788918733.715770:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865697024 00000100:00100000:0.0:1788918733.715778:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865697024 00000100:00100000:0.0:1788918733.715827:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788918733.715837:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe08bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:16586:x1875816865697024:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788918733.715860:0:14985:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788918733.715875:0:14985:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788918733.720067:0:14985:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788918733.720084:0:14985:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788918733.720595:0:15006:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788918733.720602:0:15006:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788918733.720624:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918733.720654:0:15006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fffcb21a00/0x2811b8b2b0ac9ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9ecb expref: 19 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918733.720663:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918733.720704:0:15006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fffcb21a00/0x2811b8b2b0ac9ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac9ecb expref: 19 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918733.720720:0:15006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94fffcb21a00/0x2811b8b2b0ac9ed2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9ecb expref: 19 pid: 14982 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918733.720735:0:15006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15006:1875816865697152:0@lo:104: 00000100:00100000:2.0:1788918733.720807:0:15006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918733.720853:0:15006:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbd8fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918733.720968:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe08bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:16586:x1875816865697024:12345-0@lo:253:mount.lustre.0 Request processed in 5131us (5734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918733.720979:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788918733.721129:0:14974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865697152 00000100:00100000:1.0:1788918733.721137:0:14974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865697152 00000100:00100000:1.0:1788918733.721246:0:14974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788918733.721255:0:14974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+3:15006:x1875816865697152:12345-0@lo:104: 00010000:00010000:1.0:1788918733.721268:0:14974:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9ed2 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721351:0:14974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788918733.721357:0:14974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+3:15006:x1875816865697152:12345-0@lo:104: Request processed in 104us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918733.721364:0:14974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788918733.721384:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918733.721390:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9ed2 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721397:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031000 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:1.0:1788918733.721401:0:14978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac9ed2 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721409:0:14978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac9ed2 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788918733.721417:0:14978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac9ed2 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918733.721423:0:14978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788918733.721452:0:14978:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9ed2 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721459:0:14978:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788918733.721478:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9ed2 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721486:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc0031000/0x2811b8b2b0ac9ecb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9ed2 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721510:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918733.721512:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918733.721514:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918733.721522:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788918733.721534:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865697280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788918733.721564:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918733.721598:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865697280 00000100:00100000:1.0:1788918733.721602:0:14975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865697280 00010000:00010000:1.0:1788918733.721619:0:14975:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fffcb21a00/0x2811b8b2b0ac9ed2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9ecb expref: 19 pid: 14982 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918733.721642:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788918733.721649:0:14975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3420:x1875816865697280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788918733.721659:0:14975:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918733.721664:0:14975:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fffcb21a00/0x2811b8b2b0ac9ed2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9ecb expref: 19 pid: 14982 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721675:0:14975:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fffcb21a00/0x2811b8b2b0ac9ed2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9ecb expref: 19 pid: 14982 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721690:0:14975:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721698:0:14975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788918733.721712:0:14975:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.021438088s 00010000:00010000:1.0:1788918733.721716:0:14975:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721730:0:14975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721738:0:14975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721744:0:14975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721750:0:14975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918733.721754:0:14975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721762:0:14975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721771:0:14975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721781:0:14975:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918733.721810:0:14975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3420:x1875816865697280:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918733.721817:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788918733.721852:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865697280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788918733.721886:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fffcb21a00/0x2811b8b2b0ac9ed2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac9ecb expref: 18 pid: 14982 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918733.721896:0:15006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:15006:1875816865697152:0@lo:104: 00010000:00010000:1.0:1788918733.721908:0:15006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721923:0:15006:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721929:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918733.721935:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0ac9fff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918733.722475:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:16586:1875816865697024:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788918733.722487:0:16586:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788918733.722490:0:16586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788918733.722491:0:16586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788918733.722493:0:16586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788918733.722494:0:16586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788918733.722495:0:16586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788918733.722496:0:16586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788918733.722498:0:16586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788918733.722500:0:16586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788918733.722501:0:16586:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788918733.722512:0:16586:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1788918733.733412:0:16586:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788918733.737158:0:16586:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788918733.737231:0:16586:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788918733.737270:0:16586:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788918733.737390:0:16586:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.149@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788918733.737414:0:16586:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788918733.737437:0:16586:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788918733.738192:0:16586:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788918733.738398:0:16586:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788918733.910557:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788918733.910588:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865697408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918733.910665:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918733.911181:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865697408 00000100:00100000:0.0:1788918733.911190:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865697408 00000100:00100000:0.0:1788918733.911284:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788918733.911295:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865697408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788918733.911340:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918733.911403:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865697408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918733.911429:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788918733.911503:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865697408:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788918734.550327:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788918734.908415:0:16651:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788918734.908661:0:16651:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788918735.190161:0:14987:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788918735.190170:0:14987:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94fffcaab000 from 8 10000000:01000000:1.0:1788918735.190174:0:14987:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788918735.190227:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0aca006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918735.190240:0:14987:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0aca006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918735.190251:0:14987:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0aca006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918735.190278:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff846680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865697536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788918735.190363:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918735.190441:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc894f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788918735.190596:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865697536 00000100:00100000:0.0:1788918735.190614:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865697536 00000100:00100000:0.0:1788918735.190664:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788918735.190673:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff742c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:14987:x1875816865697536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788918735.190688:0:14982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918735.190703:0:14982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcb20a00/0x2811b8b2b0aca00d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0aca006 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918735.190734:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcb20a00/0x2811b8b2b0aca00d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0aca006 expref: 19 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918735.190746:0:14982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcb20a00/0x2811b8b2b0aca00d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0aca006 expref: 19 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918735.190756:0:14982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcb20a00, rc 0) 00000100:00100000:0.0:1788918735.190798:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff742c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:14987:x1875816865697536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918735.190804:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788918735.191138:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff846680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865697536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788918735.191164:0:14987:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0aca006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0aca00d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918735.191174:0:14987:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0aca006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0aca00d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918735.191236:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff846680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865697664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788918735.191268:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918735.191293:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc894f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788918735.191425:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865697664 00000100:00100000:3.0:1788918735.191432:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865697664 00000100:00100000:3.0:1788918735.191471:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788918735.191479:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff743850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:14987:x1875816865697664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788918735.191493:0:14985:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788918735.191508:0:14985:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788918735.191511:0:14985:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788918735.191594:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff743850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:14987:x1875816865697664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918735.191613:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788918735.191735:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff846680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865697664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788918735.191798:0:14987:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788918735.191805:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0aca006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0aca00d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918735.191815:0:14987:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fffcbc4c00/0x2811b8b2b0aca006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0aca00d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918735.575377:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918736.601546:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918737.624361:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918738.650474:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918739.035433:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788918739.035463:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865697792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918739.035535:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918739.035612:0:15777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865697792 00000100:00100000:1.0:1788918739.035622:0:15777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865697792 00000100:00100000:1.0:1788918739.035682:0:15777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788918739.035693:0:15777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865697792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788918739.035729:0:15777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918739.035777:0:15777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3418:x1875816865697792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918739.035784:0:15777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788918739.035806:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918739.035847:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865697792:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788918739.036515:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788918739.036521:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788918739.036525:0:469:0:(import.c:65:import_set_state_nolock()) ffff94ffd0565800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788918739.036533:0:469:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94ffd0565800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788918739.036554:0:469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94ffefcb3b80 x1875816865698048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788918739.036617:0:3416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865698048:0@lo:8:kworker.0 00000100:00100000:3.0:1788918739.036656:0:3416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918739.036698:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865698176:0@lo:400:kworker.0 00000100:00100000:3.0:1788918739.036726:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918739.036745:0:3419:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788918739.036750:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865698304:0@lo:400:kworker.0 00000100:00100000:3.0:1788918739.036771:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918739.036813:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865698048 00000100:00100000:3.0:1788918739.036818:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865698048 00000100:00100000:3.0:1788918739.036847:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788918739.036853:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3416:x1875816865698048:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788918739.036877:0:15776:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:3.0:1788918739.036907:0:15776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2811b8b2b0aca014 00002000:00100000:3.0:1788918739.036920:0:15776:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff94ffff5ba800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788918739.036924:0:15776:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788918739.036927:0:15776:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788918739.037149:0:15776:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1788918739.037289:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3418:1875816865697920:0@lo:400:kworker.0 00000100:00100000:1.0:1788918739.037328:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918739.037355:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788918739.037361:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865698432:0@lo:400:kworker.0 00000100:00100000:1.0:1788918739.037387:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918739.037415:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865697920 00000100:00100000:1.0:1788918739.037419:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865697920 00000100:00100000:1.0:1788918739.037452:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788918739.037459:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3418:x1875816865697920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918739.037502:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff743050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3418:x1875816865697920:12345-0@lo:400:kworker.0 Request processed in 43us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918739.037509:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788918739.037549:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3418:1875816865697920:0@lo:400:kworker.0 00000100:00080000:3.0:1788918739.037671:0:15776:0:(import.c:65:import_set_state_nolock()) ffff94ffff5bf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788918739.037757:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3416:x1875816865698048:12345-0@lo:8:kworker.0 Request processed in 902us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918739.037764:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788918739.037787:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865698176 00000100:00100000:3.0:1788918739.037790:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865698176 00000100:00100000:3.0:1788918739.037811:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865698304 00000100:00100000:3.0:1788918739.037813:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865698304 00000100:00100000:3.0:1788918739.037842:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865698432 00000100:00100000:3.0:1788918739.037845:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865698432 00000100:00100000:3.0:1788918739.037859:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788918739.037864:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865698176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918739.037902:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3419:x1875816865698176:12345-0@lo:400:kworker.0 Request processed in 38us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918739.037908:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788918739.037920:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788918739.037926:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865698304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918739.037954:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3419:x1875816865698304:12345-0@lo:400:kworker.0 Request processed in 28us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918739.037972:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788918739.037984:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788918739.037990:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865698432:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788918739.038465:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918739.038560:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3418:x1875816865698432:12345-0@lo:400:kworker.0 Request processed in 568us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918739.038566:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788918739.038627:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefcb2d80 x1875816865698304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918739.038641:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3419:1875816865698304:0@lo:400:kworker.0 00010000:00080000:3.0:1788918739.038653:0:3419:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefcb2680 x1875816865698176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918739.038662:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3419:1875816865698176:0@lo:400:kworker.0 00010000:00080000:3.0:1788918739.038697:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff730000 x1875816865698432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918739.038706:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3418:1875816865698432:0@lo:400:kworker.0 00010000:00080000:0.0:1788918739.052148:0:3416:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffefcb3b80 x1875816865698048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788918764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788918739.052184:0:3416:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788918739.052193:0:3416:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788918739.052200:0:3416:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788918739.052204:0:3416:0:(import.c:65:import_set_state_nolock()) ffff94ffd0565800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788918739.052233:0:3416:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788918739.052240:0:3416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3416:1875816865698048:0@lo:8:kworker.0 00000004:00080000:2.0:1788918739.053368:0:15014:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788918739.053468:0:15014:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441334447115ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788918739.053476:0:15014:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788918739.054397:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865698560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918739.054477:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788918739.054548:0:15015:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788918739.054572:0:15015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15015:1875816865698688:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788918739.054604:0:15015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918739.054619:0:15015:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbdc5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788918739.057333:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865698688 00000100:00100000:0.0:1788918739.057348:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865698688 00000100:00100000:0.0:1788918739.057437:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788918739.057449:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:15015:x1875816865698688:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1788918739.058505:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788918739.060155:0:14970:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788918739.060935:0:15777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865698560 00000100:00100000:1.0:1788918739.060948:0:15777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865698560 00000100:00100000:1.0:1788918739.061010:0:15777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788918739.061039:0:15777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3418:x1875816865698560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918739.061072:0:15777:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923660800 avail 3692138496 00000100:00100000:1.0:1788918739.061156:0:15777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3418:x1875816865698560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (6679us total) trans 0 rc 0/0 00010000:00080000:3.0:1788918739.061457:0:3418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffff730000 x1875816865698560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788918755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918739.061478:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3418:1875816865698560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918739.061532:0:15777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00080000:1.0:1788918739.079710:0:15775:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788918739.079754:0:15775:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788918739.079763:0:15775:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1788918739.112199:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788918739.112218:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0aca01b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.112235:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788918739.112239:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918739.112246:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0aca01b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.112264:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0aca01b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.112284:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0aca01b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.112293:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0aca01b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.112314:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918739.112662:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918739.112670:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0aca01b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.112679:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918739.112685:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0aca01b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.112695:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0aca01b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.112715:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0aca01b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.112723:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000477282e2/0x2811b8b2b0aca01b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.112747:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918739.112749:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918739.112750:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788918739.115624:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788918739.115640:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d552d3e7/0x2811b8b2b0aca022 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.115659:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788918739.115665:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918739.115672:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d552d3e7/0x2811b8b2b0aca022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.115695:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d552d3e7/0x2811b8b2b0aca022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.115706:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d552d3e7/0x2811b8b2b0aca022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.115713:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d552d3e7/0x2811b8b2b0aca022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.115738:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918739.115984:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918739.115992:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d552d3e7/0x2811b8b2b0aca022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.116001:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918739.116007:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d552d3e7/0x2811b8b2b0aca022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.116053:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d552d3e7/0x2811b8b2b0aca022 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.116074:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d552d3e7/0x2811b8b2b0aca022 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.116083:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d552d3e7/0x2811b8b2b0aca022 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.116104:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918739.116106:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918739.116108:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788918739.119252:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788918739.119266:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca029 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.119303:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1788918739.119308:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918739.119315:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.119331:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.119342:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.119357:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.119381:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788918739.120504:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918739.120514:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.120526:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030a00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918739.120532:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.120544:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.120569:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca029 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.120576:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca029 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.120598:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918739.120600:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918739.120602:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788918739.121900:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788918739.121912:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca030 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.121928:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1788918739.121933:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918739.121939:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca030 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.121953:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca030 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.121962:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca030 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.121970:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca030 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.121994:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788918739.125240:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788918739.125254:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca037 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.125289:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1788918739.125305:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918739.125312:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.125479:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.125491:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.125499:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca037 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.125521:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788918739.125797:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788918739.125805:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca030 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.125814:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031000 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918739.125820:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca030 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.125830:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca030 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.125847:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca030 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.125856:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca030 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.125882:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918739.125886:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca037 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.125892:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030800 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918739.125896:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca037 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.125904:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca037 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.125916:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca037 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.125923:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca037 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.125936:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918739.125938:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918739.125940:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918739.125999:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788918739.128329:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788918739.128342:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca03e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.128357:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1788918739.128361:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918739.128368:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca03e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.128381:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca03e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.128404:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca03e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.128412:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca03e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.128433:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788918739.129318:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918739.129331:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca03e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.129343:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031e00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918739.129356:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca03e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.129367:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca03e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.129386:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca03e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.129394:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca03e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.129420:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918739.129422:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918739.129424:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788918739.129658:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788918739.129667:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6a8effd/0x2811b8b2b0aca045 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.129678:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1788918739.129682:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918739.129688:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6a8effd/0x2811b8b2b0aca045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.129699:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6a8effd/0x2811b8b2b0aca045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.129707:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6a8effd/0x2811b8b2b0aca045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.129715:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6a8effd/0x2811b8b2b0aca045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.129748:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788918739.130910:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918739.131000:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6a8effd/0x2811b8b2b0aca045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.131048:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5000 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918739.131054:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6a8effd/0x2811b8b2b0aca045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.131066:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6a8effd/0x2811b8b2b0aca045 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.131087:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6a8effd/0x2811b8b2b0aca045 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.131096:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6a8effd/0x2811b8b2b0aca045 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.131252:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918739.131255:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918739.131257:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788918739.136344:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788918739.136362:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068f6a599/0x2811b8b2b0aca04c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.136384:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1788918739.136389:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918739.136396:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068f6a599/0x2811b8b2b0aca04c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.136412:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068f6a599/0x2811b8b2b0aca04c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.136423:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068f6a599/0x2811b8b2b0aca04c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.136432:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068f6a599/0x2811b8b2b0aca04c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.136464:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788918739.136792:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918739.136800:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068f6a599/0x2811b8b2b0aca04c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.136808:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918739.136812:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068f6a599/0x2811b8b2b0aca04c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.136822:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068f6a599/0x2811b8b2b0aca04c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.136839:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068f6a599/0x2811b8b2b0aca04c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.136855:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068f6a599/0x2811b8b2b0aca04c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.136877:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918739.136879:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918739.136880:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788918739.138173:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918739.138185:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760d03f3/0x2811b8b2b0aca053 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.138199:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788918739.138204:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918739.138209:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000760d03f3/0x2811b8b2b0aca053 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.138222:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000760d03f3/0x2811b8b2b0aca053 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.138237:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000760d03f3/0x2811b8b2b0aca053 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.138246:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000760d03f3/0x2811b8b2b0aca053 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.138265:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788918739.138708:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918739.138716:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfa2b0c2/0x2811b8b2b0aca05a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.138727:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788918739.138729:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918739.138734:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfa2b0c2/0x2811b8b2b0aca05a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.138743:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfa2b0c2/0x2811b8b2b0aca05a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.138751:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfa2b0c2/0x2811b8b2b0aca05a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.138759:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfa2b0c2/0x2811b8b2b0aca05a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.138991:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788918739.139003:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788918739.139008:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000760d03f3/0x2811b8b2b0aca053 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139017:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918739.139048:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000760d03f3/0x2811b8b2b0aca053 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139058:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000760d03f3/0x2811b8b2b0aca053 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139074:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000760d03f3/0x2811b8b2b0aca053 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139083:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000760d03f3/0x2811b8b2b0aca053 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139102:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918739.139105:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfa2b0c2/0x2811b8b2b0aca05a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139111:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21a00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918739.139170:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfa2b0c2/0x2811b8b2b0aca05a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139193:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfa2b0c2/0x2811b8b2b0aca05a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139206:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfa2b0c2/0x2811b8b2b0aca05a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139214:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfa2b0c2/0x2811b8b2b0aca05a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139237:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918739.139239:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918739.139242:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788918739.139603:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918739.139610:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0aca061 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139620:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788918739.139624:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918739.139628:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0aca061 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139639:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0aca061 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139648:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0aca061 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139664:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0aca061 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139680:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788918739.139689:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918739.139693:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0aca061 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139699:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb21e00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918739.139703:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0aca061 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139711:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0aca061 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139722:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0aca061 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139729:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac944ce6/0x2811b8b2b0aca061 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.139742:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918739.139744:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918739.139745:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788918739.141111:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918739.141193:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d14305/0x2811b8b2b0aca068 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.141210:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788918739.141215:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918739.141221:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084d14305/0x2811b8b2b0aca068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.141234:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084d14305/0x2811b8b2b0aca068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.141244:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d14305/0x2811b8b2b0aca068 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.141251:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084d14305/0x2811b8b2b0aca068 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.141270:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788918739.141299:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918739.141304:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084d14305/0x2811b8b2b0aca068 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.141313:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcb20c00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918739.141317:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d14305/0x2811b8b2b0aca068 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.141326:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d14305/0x2811b8b2b0aca068 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.141352:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084d14305/0x2811b8b2b0aca068 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.141362:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084d14305/0x2811b8b2b0aca068 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.141382:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918739.141384:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918739.141386:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918739.142151:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788918739.142261:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918739.142269:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca06f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.142292:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788918739.142297:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918739.142302:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca06f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.142314:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca06f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.142323:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca06f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.142331:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca06f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.142417:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788918739.144429:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918739.144440:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca076 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.144456:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788918739.144460:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918739.144466:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca076 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.144479:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca076 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.144488:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca076 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.144496:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca076 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.149135:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788918739.149153:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca06f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.149168:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030a00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918739.149173:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca06f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.149186:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca06f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.149217:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca06f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.149226:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d214361/0x2811b8b2b0aca06f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.149257:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918739.149262:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca076 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.149268:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031e00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918739.149301:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca076 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.149311:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca076 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.149340:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca076 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.149350:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918739.149352:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918739.149354:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918739.149497:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788918739.149505:0:15775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfd00cbf/0x2811b8b2b0aca076 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788918739.150298:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918739.150307:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca07d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.150327:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788918739.150332:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918739.150337:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca07d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.150349:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca07d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.150360:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca07d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.150368:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca07d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.150393:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788918739.150679:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918739.150686:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca07d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.150694:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030800 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918739.150698:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca07d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.150705:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca07d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.150718:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca07d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.150725:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c740a685/0x2811b8b2b0aca07d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.150741:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918739.150743:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918739.150745:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788918739.151214:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918739.151221:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca084 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.151231:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788918739.151234:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918739.151239:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.151250:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.151284:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca084 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.151289:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918739.151294:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.151320:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918739.151401:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918739.151408:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.151417:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031000 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918739.151429:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.151439:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.151452:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca084 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.151460:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b7fa05f/0x2811b8b2b0aca084 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.151478:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918739.151479:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918739.151482:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788918739.152301:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918739.152309:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175aac3c/0x2811b8b2b0aca08b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.152319:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788918739.152323:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918739.152327:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000175aac3c/0x2811b8b2b0aca08b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.152337:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000175aac3c/0x2811b8b2b0aca08b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.152345:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175aac3c/0x2811b8b2b0aca08b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.152352:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000175aac3c/0x2811b8b2b0aca08b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.152418:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788918739.156660:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788918739.156675:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d13b22ce/0x2811b8b2b0aca092 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.156692:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788918739.156696:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788918739.156703:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d13b22ce/0x2811b8b2b0aca092 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.156718:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d13b22ce/0x2811b8b2b0aca092 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.156730:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d13b22ce/0x2811b8b2b0aca092 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.156738:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d13b22ce/0x2811b8b2b0aca092 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.160389:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788918739.160410:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000175aac3c/0x2811b8b2b0aca08b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.160426:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691e800 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918739.160432:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000175aac3c/0x2811b8b2b0aca08b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.160445:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000175aac3c/0x2811b8b2b0aca08b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.160469:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000175aac3c/0x2811b8b2b0aca08b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.160476:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000175aac3c/0x2811b8b2b0aca08b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.160510:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918739.160515:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d13b22ce/0x2811b8b2b0aca092 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.160522:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4a00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918739.160525:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d13b22ce/0x2811b8b2b0aca092 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.160532:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d13b22ce/0x2811b8b2b0aca092 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.160567:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d13b22ce/0x2811b8b2b0aca092 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.160575:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918739.160577:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918739.160579:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918739.164291:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788918739.164308:0:15775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d13b22ce/0x2811b8b2b0aca092 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788918739.164937:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788918739.164945:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d063d324/0x2811b8b2b0aca099 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.164958:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788918739.164962:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918739.164969:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d063d324/0x2811b8b2b0aca099 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.164982:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d063d324/0x2811b8b2b0aca099 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.164992:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d063d324/0x2811b8b2b0aca099 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.165001:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d063d324/0x2811b8b2b0aca099 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918739.165050:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788918739.165922:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788918739.165932:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d063d324/0x2811b8b2b0aca099 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.165944:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691e400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918739.165949:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d063d324/0x2811b8b2b0aca099 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.165959:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d063d324/0x2811b8b2b0aca099 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.165976:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d063d324/0x2811b8b2b0aca099 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.165983:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d063d324/0x2811b8b2b0aca099 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.166001:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918739.166003:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788918739.166005:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788918739.166100:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918739.166106:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed7cddf2/0x2811b8b2b0aca0a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.166126:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788918739.166131:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918739.166137:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7cddf2/0x2811b8b2b0aca0a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.166148:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed7cddf2/0x2811b8b2b0aca0a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.166156:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed7cddf2/0x2811b8b2b0aca0a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.166163:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed7cddf2/0x2811b8b2b0aca0a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.166180:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788918739.166265:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918739.166282:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed7cddf2/0x2811b8b2b0aca0a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.166291:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dca00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918739.166295:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7cddf2/0x2811b8b2b0aca0a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.166303:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed7cddf2/0x2811b8b2b0aca0a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.166317:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed7cddf2/0x2811b8b2b0aca0a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.166332:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed7cddf2/0x2811b8b2b0aca0a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.166349:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918739.166350:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918739.166352:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788918739.167087:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918739.167096:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d0bd0f3/0x2811b8b2b0aca0a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.167110:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788918739.167124:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918739.167130:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d0bd0f3/0x2811b8b2b0aca0a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.167154:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d0bd0f3/0x2811b8b2b0aca0a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.167164:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d0bd0f3/0x2811b8b2b0aca0a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.167171:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d0bd0f3/0x2811b8b2b0aca0a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.167184:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788918739.167979:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918739.167989:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0aca0ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168002:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788918739.168005:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918739.168010:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0aca0ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168042:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0aca0ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168052:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0aca0ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168071:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0aca0ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168082:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788918739.168540:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918739.168546:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea68468e/0x2811b8b2b0aca0b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168555:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788918739.168558:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918739.168562:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea68468e/0x2811b8b2b0aca0b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168572:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea68468e/0x2811b8b2b0aca0b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168580:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea68468e/0x2811b8b2b0aca0b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168587:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea68468e/0x2811b8b2b0aca0b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168595:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788918739.168887:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918739.168893:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008dc0c33/0x2811b8b2b0aca0bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168907:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788918739.168910:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918739.168914:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008dc0c33/0x2811b8b2b0aca0bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168936:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008dc0c33/0x2811b8b2b0aca0bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168945:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008dc0c33/0x2811b8b2b0aca0bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168951:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008dc0c33/0x2811b8b2b0aca0bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.168961:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788918739.169300:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788918739.169309:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d0bd0f3/0x2811b8b2b0aca0a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169318:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48ddc00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918739.169322:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d0bd0f3/0x2811b8b2b0aca0a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169332:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d0bd0f3/0x2811b8b2b0aca0a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169349:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d0bd0f3/0x2811b8b2b0aca0a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169357:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d0bd0f3/0x2811b8b2b0aca0a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169378:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788918739.169381:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0aca0ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169386:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc800 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918739.169390:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0aca0ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169409:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0aca0ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169419:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0aca0ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169426:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b045783/0x2811b8b2b0aca0ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169439:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788918739.169442:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea68468e/0x2811b8b2b0aca0b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169448:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd000 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918739.169451:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea68468e/0x2811b8b2b0aca0b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169458:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea68468e/0x2811b8b2b0aca0b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169468:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea68468e/0x2811b8b2b0aca0b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169475:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea68468e/0x2811b8b2b0aca0b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169498:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918739.169501:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008dc0c33/0x2811b8b2b0aca0bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169507:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918739.169510:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008dc0c33/0x2811b8b2b0aca0bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169518:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008dc0c33/0x2811b8b2b0aca0bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169528:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008dc0c33/0x2811b8b2b0aca0bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169535:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008dc0c33/0x2811b8b2b0aca0bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.169545:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918739.169547:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918739.169549:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788918739.170113:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918739.170131:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f51f2700/0x2811b8b2b0aca0c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.170143:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788918739.170147:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918739.170153:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51f2700/0x2811b8b2b0aca0c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.170165:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f51f2700/0x2811b8b2b0aca0c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.170186:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f51f2700/0x2811b8b2b0aca0c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.170194:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f51f2700/0x2811b8b2b0aca0c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.170211:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788918739.170283:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918739.170290:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f51f2700/0x2811b8b2b0aca0c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.170299:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918739.170309:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f51f2700/0x2811b8b2b0aca0c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.170318:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f51f2700/0x2811b8b2b0aca0c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.170331:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f51f2700/0x2811b8b2b0aca0c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.170339:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f51f2700/0x2811b8b2b0aca0c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.170354:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918739.170356:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918739.170358:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788918739.170851:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918739.170857:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0aca0ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.170868:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788918739.170871:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918739.170875:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0aca0ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.170885:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0aca0ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.170893:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0aca0ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.170899:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0aca0ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.171017:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788918739.171282:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788918739.171289:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0aca0ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.171297:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd600 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:1.0:1788918739.171301:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0aca0ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.171308:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0aca0ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.171321:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0aca0ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.171335:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9865882/0x2811b8b2b0aca0ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918739.171355:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918739.171357:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918739.171359:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788918739.171657:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788918739.171663:0:15775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5538e95/0x2811b8b2b0aca0d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.171674:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788918739.171677:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788918739.171681:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5538e95/0x2811b8b2b0aca0d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.171691:0:15775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5538e95/0x2811b8b2b0aca0d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.171699:0:15775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5538e95/0x2811b8b2b0aca0d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.171706:0:15775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5538e95/0x2811b8b2b0aca0d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918739.171731:0:15775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788918739.171773:0:15775:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1788918739.172223:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:15015:x1875816865698688:12345-0@lo:5:osp-pre-1-0.0 Request processed in 114771us (117612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918739.172233:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788918739.173360:0:15015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15015:1875816865698688:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788918739.173381:0:15015:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788918739.173436:0:15015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff731c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15015:1875816865698816:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788918739.173494:0:15015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918739.173552:0:15015:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbdc5c00 going to sleep for 11 seconds 00010000:00010000:3.0:1788918739.173569:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788918739.173576:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5538e95/0x2811b8b2b0aca0d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.173587:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd400 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:3.0:1788918739.173592:0:14978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5538e95/0x2811b8b2b0aca0d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.173603:0:14978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5538e95/0x2811b8b2b0aca0d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.173622:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5538e95/0x2811b8b2b0aca0d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918739.173647:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5538e95/0x2811b8b2b0aca0d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918739.173663:0:15773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865698816 00010000:00010000:3.0:1788918739.173669:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918739.173671:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918739.173675:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918739.173680:0:15773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865698816 00000100:00100000:2.0:1788918739.173741:0:15773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788918739.173753:0:15773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:15015:x1875816865698816:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788918739.173818:0:15773:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1788918739.174435:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788918739.186432:0:16587:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788918739.186500:0:16587:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788918739.187209:0:15773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:15015:x1875816865698816:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13453us (13709us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788918739.187222:0:15773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788918739.187302:0:15015:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788918739.187310:0:15015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff731c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:15015:1875816865698816:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788918739.187326:0:15015:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788918739.671204:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788918740.377645:0:15024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788918740.694326:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788918741.323841:0:16941:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788918741.729376:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788918742.404866:0:16993:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788918742.405528:0:16993:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788918742.743339:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788918743.416577:0:17043:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788918743.416794:0:17043:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788918743.766385:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918743.924887:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918743.928512:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855219072 00000100:00100000:2.0:1788918743.928529:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855219072 00000100:00100000:1.0:1788918743.929532:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 76 00000100:00100000:1.0:1788918743.929542:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1875816855219072:12345-192.168.202.49@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788918743.929588:0:14983:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from cac7e71b-3a4a-4e21-98c7-3442fe38ec4c@192.168.202.49@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:1.0:1788918743.929622:0:14983:0:(genops.c:1385:class_connect()) connect: client cac7e71b-3a4a-4e21-98c7-3442fe38ec4c, cookie 0x2811b8b2b0aca0d8 00000100:00080000:1.0:1788918743.929781:0:14983:0:(import.c:65:import_set_state_nolock()) ffff94fffc447000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788918743.929860:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+5:2348:x1875816855219072:12345-192.168.202.49@tcp:250:mount.lustre.0 Request processed in 317us (4984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918743.929869:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 76 00000100:00100000:3.0:1788918743.949006:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918743.949675:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855219200 00000100:00100000:0.0:1788918743.949686:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855219200 00000100:00100000:0.0:1788918743.949748:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00100000:0.0:1788918743.949757:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+5:13663:x1875816855219200:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788918743.949791:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918743.949809:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff691fa00/0x2811b8b2b0aca0df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f0790 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918743.949838:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691fa00/0x2811b8b2b0aca0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0790 expref: 6 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918743.949849:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff691fa00/0x2811b8b2b0aca0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0790 expref: 6 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918743.949859:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691fa00, rc 0) 00000100:00100000:0.0:1788918743.949928:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+6:13663:x1875816855219200:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 171us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918743.949935:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00100000:0.0:1788918743.972382:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918743.972478:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855219328 00000100:00100000:3.0:1788918743.972489:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855219328 00000100:00100000:3.0:1788918743.972562:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 78 00000100:00100000:3.0:1788918743.972573:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff740050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+6:13663:x1875816855219328:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788918743.972708:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff740050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+6:13663:x1875816855219328:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 135us (335us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788918743.972717:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 78 00000100:00100000:2.0:1788918743.987960:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918743.988134:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855219456 00000100:00100000:1.0:1788918743.988145:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855219456 00000100:00100000:1.0:1788918743.988207:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:1.0:1788918743.988218:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff740c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+6:13663:x1875816855219456:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788918743.988247:0:14983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918743.988268:0:14983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcbc4600/0x2811b8b2b0aca0e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f0797 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918743.988301:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcbc4600/0x2811b8b2b0aca0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0797 expref: 7 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918743.988313:0:14983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcbc4600/0x2811b8b2b0aca0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0797 expref: 7 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918743.988323:0:14983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4600, rc 0) 00000100:00100000:1.0:1788918743.988388:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff740c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+7:13663:x1875816855219456:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 171us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918743.988395:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:1.0:1788918743.993569:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918743.993675:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855219584 00000100:00100000:0.0:1788918743.993686:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855219584 00000100:00100000:0.0:1788918743.993751:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:0.0:1788918743.993763:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff740850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+7:13663:x1875816855219584:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788918743.993937:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff740850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+8:13663:x1875816855219584:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 175us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918743.993946:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:0.0:1788918744.003141:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918744.003249:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855219712 00000100:00100000:3.0:1788918744.003259:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855219712 00000100:00100000:3.0:1788918744.003315:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00100000:3.0:1788918744.003326:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+8:13663:x1875816855219712:12345-192.168.202.49@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788918744.003465:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+8:13663:x1875816855219712:12345-192.168.202.49@tcp:503:mount.lustre.0 Request processed in 140us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918744.003481:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00100000:2.0:1788918744.009873:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918744.010476:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855219840 00000100:00100000:1.0:1788918744.010486:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855219840 00000100:00100000:1.0:1788918744.010562:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 82 00000100:00100000:1.0:1788918744.010576:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+8:13681:x1875816855219840:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788918744.010761:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+8:13681:x1875816855219840:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 187us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918744.010777:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 82 00000100:00100000:1.0:1788918744.046268:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918744.046481:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855219968 00000100:00100000:0.0:1788918744.046494:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855219968 00000100:00100000:0.0:1788918744.046561:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 83 00000100:00100000:0.0:1788918744.046581:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+8:13681:x1875816855219968:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788918744.046746:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+8:13681:x1875816855219968:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 167us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918744.046754:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 83 00000100:00100000:0.0:1788918744.065968:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918744.066334:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855220096 00000100:00100000:3.0:1788918744.066350:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855220096 00000100:00100000:3.0:1788918744.066431:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:3.0:1788918744.066442:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+8:13663:x1875816855220096:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788918744.066460:0:14982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918744.066479:0:14982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffefbf5c00/0x2811b8b2b0aca0ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f07c1 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918744.066510:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffefbf5c00/0x2811b8b2b0aca0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f07c1 expref: 9 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918744.066523:0:14982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffefbf5c00/0x2811b8b2b0aca0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f07c1 expref: 9 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918744.066532:0:14982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5c00, rc 0) 00000100:00100000:3.0:1788918744.066617:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+9:13663:x1875816855220096:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 176us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918744.066624:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:2.0:1788918744.078203:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918744.078534:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855220224 00000100:00100000:1.0:1788918744.078762:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855220224 00000100:00100000:1.0:1788918744.078904:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:1.0:1788918744.078914:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+9:13663:x1875816855220224:12345-192.168.202.49@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788918744.078943:0:14983:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788918744.078969:0:14983:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788918744.078974:0:14983:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788918744.078977:0:14983:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788918744.078980:0:14983:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788918744.087542:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+9:13663:x1875816855220224:12345-192.168.202.49@tcp:256:mount.lustre.0 Request processed in 8615us (9337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918744.087574:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:0.0:1788918744.093223:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918744.093355:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855220352 00000100:00100000:3.0:1788918744.093370:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855220352 00000100:00100000:3.0:1788918744.093445:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 86 00000100:00100000:3.0:1788918744.093457:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+9:13663:x1875816855220352:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788918744.093479:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918744.093501:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffefbf5200/0x2811b8b2b0aca0f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f07c8 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918744.093562:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffefbf5200/0x2811b8b2b0aca0f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f07c8 expref: 10 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918744.093575:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffefbf5200/0x2811b8b2b0aca0f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f07c8 expref: 10 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918744.093588:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5200, rc 0) 00000100:00100000:3.0:1788918744.093988:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+10:13663:x1875816855220352:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 530us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918744.093997:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 86 00000100:00100000:0.0:1788918744.096197:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918744.096482:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855220480 00000100:00100000:2.0:1788918744.096496:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855220480 00000100:00100000:2.0:1788918744.096563:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 87 00000100:00100000:2.0:1788918744.096574:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff740450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+10:13663:x1875816855220480:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788918744.096876:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff740450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+10:13663:x1875816855220480:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 302us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918744.096885:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 87 00000100:00100000:1.0:1788918744.099198:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918744.099581:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855220608 00000100:00100000:3.0:1788918744.099596:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855220608 00000100:00100000:3.0:1788918744.099845:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 88 00000100:00100000:3.0:1788918744.099858:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+10:13663:x1875816855220608:12345-192.168.202.49@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788918744.100575:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+10:13663:x1875816855220608:12345-192.168.202.49@tcp:503:mount.lustre.0 Request processed in 713us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918744.100588:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 88 00000100:00100000:3.0:1788918744.104168:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918744.104311:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855220736 00000100:00100000:0.0:1788918744.104327:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855220736 00000100:00100000:0.0:1788918744.104412:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00100000:0.0:1788918744.104425:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+10:13687:x1875816855220736:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788918744.104707:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+10:13687:x1875816855220736:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 283us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918744.104717:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00100000:0.0:1788918744.116512:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918744.117205:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855220864 00000100:00100000:3.0:1788918744.117220:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855220864 00000100:00100000:3.0:1788918744.117379:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 90 00000100:00100000:3.0:1788918744.117393:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+10:13687:x1875816855220864:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788918744.117613:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+10:13687:x1875816855220864:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 222us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918744.117622:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 90 00000100:00100000:1.0:1788918744.140442:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918744.140566:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855220992 00000100:00100000:3.0:1788918744.140579:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855220992 00000100:00100000:3.0:1788918744.140647:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:3.0:1788918744.140661:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1875816855220992:12345-192.168.202.49@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788918744.140697:0:14992:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e3eafaaf-3723-469d-8a5a-feb4556ed7a1@192.168.202.49@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:3.0:1788918744.140761:0:14992:0:(genops.c:1385:class_connect()) connect: client e3eafaaf-3723-469d-8a5a-feb4556ed7a1, cookie 0x2811b8b2b0aca0fb 00000004:00100000:3.0:1788918744.140794:0:14992:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788918744.140801:0:14992:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788918744.151401:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788918744.151435:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865698944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918744.151535:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918744.151897:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865698944 00000100:00100000:2.0:1788918744.151912:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865698944 00000100:00100000:2.0:1788918744.152000:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788918744.152011:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865698944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918744.152088:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918744.152179:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865698944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918744.152199:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788918744.155203:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918744.155261:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865699072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918744.155362:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918744.155423:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865699584:0@lo:400:kworker.0 00000100:00100000:1.0:1788918744.155456:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918744.155516:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865698944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918744.155548:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788918744.155554:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865699456:0@lo:400:kworker.0 00000100:00100000:1.0:1788918744.155577:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918744.155620:0:14991:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788918744.155629:0:14991:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788918744.155794:0:14990:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788918744.155803:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865699584 00000100:00100000:1.0:1788918744.155830:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865699584 00000100:00100000:1.0:1788918744.155889:0:14990:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788918744.155894:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865699456 00000100:00100000:1.0:1788918744.155897:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865699456 00000100:00100000:1.0:1788918744.155910:0:14990:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788918744.155919:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788918744.155928:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865699584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918744.155987:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865699584:12345-0@lo:400:kworker.0 Request processed in 59us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918744.155995:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788918744.156015:0:14990:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788918744.156066:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788918744.156073:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865699456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918744.156103:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3420:x1875816865699456:12345-0@lo:400:kworker.0 Request processed in 31us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918744.156110:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788918744.156127:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788918744.156153:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffffaf5880 x1875816865699456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918744.156167:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3420:1875816865699456:0@lo:400:kworker.0 00010000:00080000:1.0:1788918744.156178:0:3420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffffaf5c00 x1875816865699584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788918744.156187:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865699584:0@lo:400:kworker.0 00000100:00100000:0.0:1788918744.157537:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865699072 00000100:00100000:0.0:1788918744.157553:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865699072 00000100:00100000:0.0:1788918744.157647:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788918744.157665:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865699072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788918744.157703:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1788918744.157794:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865699072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (2432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918744.157802:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788918744.157860:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865699072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918744.157978:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3417:1875816865699200:0@lo:400:kworker.0 00000100:00100000:3.0:1788918744.158063:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918744.158098:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865699712:0@lo:400:kworker.0 00000100:00100000:3.0:1788918744.158125:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918744.158150:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788918744.158156:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865699328:0@lo:400:kworker.0 00000100:00100000:3.0:1788918744.158179:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918744.158225:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865699712 00000100:00100000:3.0:1788918744.158388:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865699712 00000100:00100000:3.0:1788918744.158430:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788918744.158437:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865699712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918744.158481:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3417:x1875816865699712:12345-0@lo:400:kworker.0 Request processed in 45us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918744.158488:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788918744.158522:0:3417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94ffffaf5f80 x1875816865699712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788918760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788918744.158535:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3417:1875816865699712:0@lo:400:kworker.0 00000100:00080000:3.0:1788918744.158904:0:14992:0:(import.c:65:import_set_state_nolock()) ffff94ffff5e0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788918744.158969:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:2348:x1875816855220992:12345-192.168.202.49@tcp:38:mount.lustre.0 Request processed in 18312us (18540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918744.158977:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:2.0:1788918744.159572:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865699328 00000100:00100000:2.0:1788918744.159581:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865699328 00000100:00100000:2.0:1788918744.159629:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788918744.159652:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865699328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918744.159725:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865699328:12345-0@lo:400:kworker.0 Request processed in 75us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918744.159732:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788918744.159913:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788918744.159920:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788918744.160558:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865699200 00000100:00100000:0.0:1788918744.160569:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865699200 00000100:00100000:3.0:1788918744.161177:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865699328:0@lo:400:kworker.0 00000100:00100000:2.0:1788918744.161309:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788918744.161329:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3417:x1875816865699200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918744.161419:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3417:x1875816865699200:12345-0@lo:400:kworker.0 Request processed in 98us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918744.161427:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788918744.163387:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918744.163423:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918744.163499:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855221248 00000100:00100000:3.0:1788918744.163512:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855221248 00000100:00100000:3.0:1788918744.163591:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855221120 00000100:00100000:3.0:1788918744.163595:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855221120 00000100:00100000:3.0:1788918744.163618:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:3.0:1788918744.163629:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:13663:x1875816855221248:12345-192.168.202.49@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788918744.163706:0:14990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446334464 avail 1300094976 00000100:00100000:3.0:1788918744.163830:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:13663:x1875816855221248:12345-192.168.202.49@tcp:41:mount.lustre.0 Request processed in 202us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918744.163838:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:3.0:1788918744.163857:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:3.0:1788918744.163864:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:0:x1875816855221120:12345-192.168.202.49@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788918744.163876:0:14990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446334464 avail 1300094976 00000100:00100000:3.0:1788918744.163900:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:0:x1875816855221120:12345-192.168.202.49@tcp:41:mount.lustre.0 Request processed in 36us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918744.163906:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00080000:0.0:1788918744.173591:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918744.176178:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918744.176381:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855221376 00000100:00100000:0.0:1788918744.176394:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855221376 00000100:00100000:0.0:1788918744.176456:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:0.0:1788918744.176466:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:13663:x1875816855221376:12345-192.168.202.49@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788918744.176570:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:13663:x1875816855221376:12345-192.168.202.49@tcp:40:mount.lustre.0 Request processed in 105us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918744.176578:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:2.0:1788918744.181883:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3417:1875816865699200:0@lo:400:kworker.0 00000100:00100000:3.0:1788918744.188644:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918744.188766:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918744.199607:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918744.199907:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855221760 00000100:00100000:1.0:1788918744.199926:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855221760 00000100:00100000:1.0:1788918744.200112:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:1.0:1788918744.200127:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:13663:x1875816855221760:12345-192.168.202.49@tcp:33:mount.lustre.0 00000100:00100000:2.0:1788918744.200488:0:15773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855221504 00000100:00100000:2.0:1788918744.200501:0:15773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855221504 00000100:00100000:0.0:1788918744.203504:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855221632 00000100:00100000:0.0:1788918744.203535:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855221632 00000100:00100000:0.0:1788918744.203619:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:0.0:1788918744.203632:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875816855221632:12345-192.168.202.49@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788918744.203681:0:15775:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e3eafaaf-3723-469d-8a5a-feb4556ed7a1@192.168.202.49@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:0.0:1788918744.203742:0:15775:0:(genops.c:1385:class_connect()) connect: client e3eafaaf-3723-469d-8a5a-feb4556ed7a1, cookie 0x2811b8b2b0aca102 00002000:00100000:0.0:1788918744.203759:0:15775:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e3eafaaf-3723-469d-8a5a-feb4556ed7a1/ffff94ffe2a9d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788918744.203774:0:15775:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788918744.204084:0:15775:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788918744.204139:0:15775:0:(import.c:65:import_set_state_nolock()) ffff94ffcaa24000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788918744.204265:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:2348:x1875816855221632:12345-192.168.202.49@tcp:8:mount.lustre.0 Request processed in 632us (15496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918744.204277:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:0.0:1788918744.204579:0:15773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:0.0:1788918744.204587:0:15773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875816855221504:12345-192.168.202.49@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788918744.204625:0:15773:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e3eafaaf-3723-469d-8a5a-feb4556ed7a1@192.168.202.49@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:0.0:1788918744.204668:0:15773:0:(genops.c:1385:class_connect()) connect: client e3eafaaf-3723-469d-8a5a-feb4556ed7a1, cookie 0x2811b8b2b0aca109 00002000:00100000:0.0:1788918744.204679:0:15773:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e3eafaaf-3723-469d-8a5a-feb4556ed7a1/ffff94ffefc91800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788918744.204688:0:15773:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00080000:3.0:1788918744.205621:0:14993:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5348us 00002000:00080000:0.0:1788918744.212361:0:15773:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788918744.212441:0:15773:0:(import.c:65:import_set_state_nolock()) ffff94ffefc95000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788918744.212649:0:15773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:2348:x1875816855221504:12345-192.168.202.49@tcp:8:mount.lustre.0 Request processed in 8053us (24011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918744.212663:0:15773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000004:00200000:3.0:1788918744.231199:0:14993:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788918744.231375:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:13663:x1875816855221760:12345-192.168.202.49@tcp:33:mount.lustre.0 Request processed in 31246us (31774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918744.231392:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:3.0:1788918744.405857:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918744.406171:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855221888 00000100:00100000:0.0:1788918744.406184:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855221888 00000100:00100000:0.0:1788918744.406341:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:0.0:1788918744.406355:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:13708:x1875816855221888:12345-192.168.202.49@tcp:101:mkdir.0 00010000:00010000:0.0:1788918744.406381:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918744.406415:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0aca110 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f07f2 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918744.406501:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca117 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918744.406518:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918744.406536:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918744.406609:0:14992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788918744.406632:0:14992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788918744.406686:0:14992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918744.406718:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0aca110 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f07f2 expref: 8 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918744.410357:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca117 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f07f2 expref: 7 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918744.410381:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681ba00) 00010000:00010000:0.0:1788918744.410385:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788918744.410390:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691f600, rc 0) 00000100:00100000:0.0:1788918744.410522:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:13708:x1875816855221888:12345-192.168.202.49@tcp:101:mkdir.0 Request processed in 4169us (4680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918744.410534:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00010000:00010000:3.0:1788918744.793772:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788918745.691768:0:16587:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e3eafaaf-3723-469d-8a5a-feb4556ed7a1 00010000:00010000:3.0:1788918745.816758:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918746.524739:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918746.524867:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855222016 00000100:00100000:3.0:1788918746.524882:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855222016 00000100:00100000:3.0:1788918746.524987:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:3.0:1788918746.525000:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:13761:x1875816855222016:12345-192.168.202.49@tcp:41:lfs.0 00000004:00000024:3.0:1788918746.525099:0:14990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446334464 avail 1300094976 00000100:00100000:3.0:1788918746.525258:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:13761:x1875816855222016:12345-192.168.202.49@tcp:41:lfs.0 Request processed in 261us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918746.525267:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00080000:0.0:1788918746.525786:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918746.530346:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918746.530460:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855222144 00000100:00100000:0.0:1788918746.530475:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855222144 00000100:00100000:0.0:1788918746.530586:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:0.0:1788918746.530598:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:13761:x1875816855222144:12345-192.168.202.49@tcp:13:lfs.0 00002000:00000024:0.0:1788918746.530641:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918746.530750:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:13761:x1875816855222144:12345-192.168.202.49@tcp:13:lfs.0 Request processed in 154us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918746.530758:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00080000:1.0:1788918746.530880:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788918746.535441:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918746.535613:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855222272 00000100:00100000:0.0:1788918746.535628:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855222272 00000100:00100000:0.0:1788918746.535798:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:0.0:1788918746.535812:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+5:13761:x1875816855222272:12345-192.168.202.49@tcp:13:lfs.0 00002000:00000024:0.0:1788918746.535871:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1788918746.536014:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+5:13761:x1875816855222272:12345-192.168.202.49@tcp:13:lfs.0 Request processed in 204us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918746.536059:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00080000:1.0:1788918746.537316:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788918746.759358:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918746.759733:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855222400 00000100:00100000:0.0:1788918746.759749:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855222400 00000100:00100000:2.0:1788918746.759937:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 92 00000100:00100000:2.0:1788918746.759991:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+10:13792:x1875816855222400:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788918746.760016:0:14983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918746.760108:0:14983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff48dd600/0x2811b8b2b0aca11e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f07f9 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918746.760150:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dd600/0x2811b8b2b0aca11e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f07f9 expref: 11 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918746.760186:0:14983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff48dd600/0x2811b8b2b0aca11e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f07f9 expref: 11 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918746.760196:0:14983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd600, rc 0) 00000100:00100000:2.0:1788918746.760300:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+11:13792:x1875816855222400:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 315us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918746.760309:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 92 00000100:00100000:3.0:1788918746.778571:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918746.785228:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855222528 00000100:00100000:0.0:1788918746.785256:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855222528 00000100:00100000:0.0:1788918746.785387:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 93 00000100:00100000:0.0:1788918746.785405:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+11:13792:x1875816855222528:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788918746.785647:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+11:13792:x1875816855222528:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 247us (7092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918746.785658:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 93 00000100:00100000:2.0:1788918746.796993:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918746.799617:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855222656 00000100:00100000:0.0:1788918746.799639:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855222656 00000100:00100000:0.0:1788918746.799754:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 94 00000100:00100000:0.0:1788918746.799769:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+11:13792:x1875816855222656:12345-192.168.202.49@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788918746.800001:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+11:13792:x1875816855222656:12345-192.168.202.49@tcp:503:mount.lustre.0 Request processed in 235us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918746.800010:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 94 00000100:00100000:3.0:1788918746.819805:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918746.820507:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855222784 00000100:00100000:2.0:1788918746.820523:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855222784 00000100:00100000:2.0:1788918746.820608:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 95 00000100:00100000:2.0:1788918746.820620:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+11:13800:x1875816855222784:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788918746.820875:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+11:13800:x1875816855222784:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 255us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918746.820883:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 95 00010000:00010000:3.0:1788918746.838717:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918746.849106:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918746.849261:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855222912 00000100:00100000:3.0:1788918746.849276:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855222912 00000100:00100000:3.0:1788918746.849365:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 96 00000100:00100000:3.0:1788918746.849378:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+11:13800:x1875816855222912:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788918746.849609:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+11:13800:x1875816855222912:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 233us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918746.849630:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 96 00000100:00100000:3.0:1788918746.874107:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918746.874526:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855223040 00000100:00100000:0.0:1788918746.874545:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855223040 00000100:00100000:0.0:1788918746.874626:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 97 00000100:00100000:0.0:1788918746.874638:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+11:13792:x1875816855223040:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788918746.874681:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918746.874704:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff691e000/0x2811b8b2b0aca125 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f0823 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918746.874747:0:14985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691e000/0x2811b8b2b0aca125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0823 expref: 12 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918746.874762:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff691e000/0x2811b8b2b0aca125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0823 expref: 12 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918746.874774:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691e000, rc 0) 00000100:00100000:0.0:1788918746.874860:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+12:13792:x1875816855223040:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 224us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918746.874869:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 97 00000100:00100000:0.0:1788918746.879954:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918746.880081:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855223168 00000100:00100000:2.0:1788918746.880095:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855223168 00000100:00100000:2.0:1788918746.880171:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 98 00000100:00100000:2.0:1788918746.880185:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+12:13792:x1875816855223168:12345-192.168.202.49@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788918746.880236:0:14983:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788918746.880270:0:14983:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788918746.880275:0:14983:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788918746.880279:0:14983:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788918746.880282:0:14983:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788918746.884679:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+12:13792:x1875816855223168:12345-192.168.202.49@tcp:256:mount.lustre.0 Request processed in 4481us (4725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918746.884699:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 98 00000100:00100000:3.0:1788918746.896769:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918746.896904:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855223296 00000100:00100000:0.0:1788918746.896919:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855223296 00000100:00100000:0.0:1788918746.896997:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 99 00000100:00100000:0.0:1788918746.897008:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+12:13792:x1875816855223296:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788918746.897074:0:14982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918746.897098:0:14982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0aca12c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f082a expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918746.897137:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0aca12c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f082a expref: 13 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918746.897150:0:14982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0aca12c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f082a expref: 13 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918746.897183:0:14982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691ea00, rc 0) 00000100:00100000:0.0:1788918746.897278:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13792:x1875816855223296:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 272us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918746.897286:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 99 00000100:00100000:0.0:1788918746.905737:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918746.906280:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855223424 00000100:00100000:1.0:1788918746.906298:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855223424 00000100:00100000:1.0:1788918746.906395:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00100000:1.0:1788918746.906407:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13792:x1875816855223424:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788918746.906633:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13792:x1875816855223424:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 227us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918746.906641:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00100000:2.0:1788918746.911073:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918746.911177:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855223552 00000100:00100000:3.0:1788918746.911191:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855223552 00000100:00100000:3.0:1788918746.911330:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 101 00000100:00100000:3.0:1788918746.911342:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff6b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13792:x1875816855223552:12345-192.168.202.49@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788918746.911548:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff6b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13792:x1875816855223552:12345-192.168.202.49@tcp:503:mount.lustre.0 Request processed in 207us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918746.911558:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 101 00000100:00100000:3.0:1788918746.927340:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918746.927869:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855223680 00000100:00100000:0.0:1788918746.927887:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855223680 00000100:00100000:0.0:1788918746.927977:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 102 00000100:00100000:0.0:1788918746.927990:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13805:x1875816855223680:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788918746.928258:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13805:x1875816855223680:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 270us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918746.928266:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 102 00000100:00100000:0.0:1788918746.945420:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918746.945596:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855223808 00000100:00100000:1.0:1788918746.945619:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855223808 00000100:00100000:1.0:1788918746.945704:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 103 00000100:00100000:1.0:1788918746.945717:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13805:x1875816855223808:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788918746.959554:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13805:x1875816855223808:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 13823us (14133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918746.959573:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 103 00000100:00100000:2.0:1788918746.970622:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918746.970974:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855223936 00000100:00100000:1.0:1788918746.970989:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855223936 00000100:00100000:1.0:1788918746.971111:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788918746.971123:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2348:x1875816855223936:12345-192.168.202.49@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788918746.971184:0:17055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 45d3e96c-a7e2-451e-8a57-d44fd0c20215@192.168.202.49@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1788918746.971245:0:17055:0:(genops.c:1385:class_connect()) connect: client 45d3e96c-a7e2-451e-8a57-d44fd0c20215, cookie 0x2811b8b2b0aca133 00000004:00100000:1.0:1788918746.971288:0:17055:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788918746.971427:0:17055:0:(import.c:65:import_set_state_nolock()) ffff94fffc447800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788918746.971527:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:2348:x1875816855223936:12345-192.168.202.49@tcp:38:mount.lustre.0 Request processed in 404us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918746.971537:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:3.0:1788918746.978623:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918746.978865:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855224064 00000100:00100000:0.0:1788918746.978880:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855224064 00000100:00100000:0.0:1788918746.978991:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:0.0:1788918746.979003:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:0:x1875816855224064:12345-192.168.202.49@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788918746.979119:0:14990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446334464 avail 1300094976 00000100:00100000:0.0:1788918746.979241:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:0:x1875816855224064:12345-192.168.202.49@tcp:41:mount.lustre.0 Request processed in 240us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918746.979249:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00080000:1.0:1788918746.980216:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918746.981706:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918746.981822:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855224192 00000100:00100000:1.0:1788918746.981837:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855224192 00000100:00100000:1.0:1788918746.981913:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:1.0:1788918746.981925:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:13792:x1875816855224192:12345-192.168.202.49@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788918746.981964:0:17055:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446334464 avail 1300094976 00000100:00100000:2.0:1788918746.982785:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:13792:x1875816855224192:12345-192.168.202.49@tcp:41:mount.lustre.0 Request processed in 856us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918746.982798:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:2.0:1788918746.987994:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918746.988255:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855224320 00000100:00100000:0.0:1788918746.988270:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855224320 00000100:00100000:0.0:1788918746.988532:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:0.0:1788918746.988545:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:13792:x1875816855224320:12345-192.168.202.49@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788918746.988928:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:13792:x1875816855224320:12345-192.168.202.49@tcp:40:mount.lustre.0 Request processed in 384us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918746.988938:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:3.0:1788918746.991991:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918746.992109:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918746.992136:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918746.992278:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855224448 00000100:00100000:2.0:1788918746.992293:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855224448 00000100:00100000:2.0:1788918746.992353:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855224576 00000100:00100000:2.0:1788918746.992356:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855224576 00000100:00100000:2.0:1788918746.992372:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:2.0:1788918746.992386:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875816855224448:12345-192.168.202.49@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788918746.992442:0:15776:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 45d3e96c-a7e2-451e-8a57-d44fd0c20215@192.168.202.49@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:2.0:1788918746.992480:0:15776:0:(genops.c:1385:class_connect()) connect: client 45d3e96c-a7e2-451e-8a57-d44fd0c20215, cookie 0x2811b8b2b0aca13a 00002000:00100000:2.0:1788918746.992496:0:15776:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 45d3e96c-a7e2-451e-8a57-d44fd0c20215/ffff94fffc547800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788918746.992510:0:15776:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788918746.992604:0:15776:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788918746.992656:0:15776:0:(import.c:65:import_set_state_nolock()) ffff94fffc541000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788918746.992759:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:2348:x1875816855224448:12345-192.168.202.49@tcp:8:mount.lustre.0 Request processed in 375us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918746.992767:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:2.0:1788918746.992785:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:2.0:1788918746.992789:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875816855224576:12345-192.168.202.49@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788918746.992805:0:15776:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 45d3e96c-a7e2-451e-8a57-d44fd0c20215@192.168.202.49@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:2.0:1788918746.992823:0:15776:0:(genops.c:1385:class_connect()) connect: client 45d3e96c-a7e2-451e-8a57-d44fd0c20215, cookie 0x2811b8b2b0aca141 00002000:00100000:2.0:1788918746.992828:0:15776:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 45d3e96c-a7e2-451e-8a57-d44fd0c20215/ffff94fffc544800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788918746.992855:0:15776:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788918746.992922:0:15776:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788918746.992939:0:15776:0:(import.c:65:import_set_state_nolock()) ffff94fffc540000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788918746.992964:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:2348:x1875816855224576:12345-192.168.202.49@tcp:8:mount.lustre.0 Request processed in 172us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918746.992971:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:1.0:1788918746.995186:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855224704 00000100:00100000:1.0:1788918746.995222:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855224704 00000100:00100000:1.0:1788918746.995492:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:1.0:1788918746.995511:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:13792:x1875816855224704:12345-192.168.202.49@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788918746.995921:0:14994:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788918746.996540:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:13792:x1875816855224704:12345-192.168.202.49@tcp:33:mount.lustre.0 Request processed in 1032us (4561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918746.996550:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:3.0:1788918747.306122:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918747.306290:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855224832 00000100:00100000:0.0:1788918747.306306:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855224832 00000100:00100000:0.0:1788918747.306409:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:0.0:1788918747.306423:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:13826:x1875816855224832:12345-192.168.202.49@tcp:101:mkdir.0 00010000:00010000:0.0:1788918747.306456:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918747.306490:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca148 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0854 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918747.306589:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca14f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918747.306608:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca14f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918747.306623:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca14f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918747.306686:0:14992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788918747.306691:0:14992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788918747.306718:0:14992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca14f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918747.306752:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca148 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0854 expref: 8 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918747.306776:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca14f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0854 expref: 7 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918747.306808:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681ba00) 00010000:00010000:0.0:1788918747.306811:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788918747.306817:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691ee00, rc 0) 00000100:00100000:0.0:1788918747.306915:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+7:13826:x1875816855224832:12345-192.168.202.49@tcp:101:mkdir.0 Request processed in 494us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918747.306922:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00010000:00010000:3.0:1788918747.865136:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918748.888692:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918749.274679:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865700224:0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.274770:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918749.274837:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788918749.274844:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865699840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918749.274867:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918749.274884:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865700352:0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.274905:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918749.274929:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865700096:0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.274950:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918749.274965:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865700608:0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.274982:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918749.274998:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788918749.275002:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865699968:0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.275059:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918749.275083:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffa8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865700480:0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.275102:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918749.275131:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865700224 00000100:00100000:2.0:1788918749.275140:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865700224 00000100:00100000:2.0:1788918749.275213:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865700096 00000100:00100000:2.0:1788918749.275229:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865700096 00000100:00100000:2.0:1788918749.275256:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788918749.275266:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865700224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.275330:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865700224:12345-0@lo:400:kworker.0 Request processed in 65us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918749.275339:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788918749.275358:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788918749.275364:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865700096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.275394:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865700096:12345-0@lo:400:kworker.0 Request processed in 30us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918749.275400:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788918749.275418:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865699840 00000100:00100000:2.0:1788918749.275422:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865699840 00000100:00100000:2.0:1788918749.275444:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788918749.275451:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865699840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788918749.275478:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923660800 avail 3692138496 00000100:00100000:2.0:1788918749.275511:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865699840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918749.275517:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788918749.275536:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865700352 00000100:00100000:2.0:1788918749.275540:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865700352 00000100:00100000:2.0:1788918749.275564:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865700608 00000100:00100000:2.0:1788918749.275566:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865700608 00000100:00100000:2.0:1788918749.275577:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865700480 00000100:00100000:2.0:1788918749.275580:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865700480 00000100:00100000:2.0:1788918749.275593:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788918749.275598:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865700352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.275628:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865700352:12345-0@lo:400:kworker.0 Request processed in 30us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918749.275642:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788918749.275654:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788918749.275660:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865700608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.275687:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865700608:12345-0@lo:400:kworker.0 Request processed in 27us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918749.275692:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788918749.275702:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788918749.275707:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865700480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.275729:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865700480:12345-0@lo:400:kworker.0 Request processed in 23us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918749.275735:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788918749.275760:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788918749.275765:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788918749.275767:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788918749.275805:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865699840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918749.275818:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865700352:0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.275826:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865700224:0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.275860:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865700480:0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.275870:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865700096:0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.275879:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865700608:0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.278977:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865699968 00000100:00100000:2.0:1788918749.279000:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865699968 00000100:00100000:2.0:1788918749.279110:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788918749.279139:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3420:x1875816865699968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918749.279284:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3420:x1875816865699968:12345-0@lo:400:kworker.0 Request processed in 148us (4223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918749.279293:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788918749.279373:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffa88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865699968:0@lo:400:kworker.0 00000100:00100000:0.0:1788918749.282002:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865700736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788918749.282126:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918749.282222:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865700736 00000100:00100000:0.0:1788918749.282232:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865700736 00000100:00100000:0.0:1788918749.282296:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788918749.282306:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865700736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788918749.282345:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788918749.282392:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865700736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918749.282400:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788918749.282453:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865700736:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788918749.799726:0:14970:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 45d3e96c-a7e2-451e-8a57-d44fd0c20215 00000001:00100000:1.0:1788918749.799746:0:14970:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e3eafaaf-3723-469d-8a5a-feb4556ed7a1 00000001:00100000:2.0:1788918749.803809:0:15770:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 45d3e96c-a7e2-451e-8a57-d44fd0c20215 00000001:00100000:2.0:1788918749.803830:0:15770:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e3eafaaf-3723-469d-8a5a-feb4556ed7a1 00010000:00010000:3.0:1788918749.911122:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788918750.615398:0:15024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788918750.704624:0:17142:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788918750.934348:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788918751.958431:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918752.433744:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918752.433791:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918752.433823:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918752.433850:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918752.433877:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918752.433912:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855225216 00000100:00100000:0.0:1788918752.433925:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855225216 00000100:00100000:0.0:1788918752.433997:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855225344 00000100:00100000:0.0:1788918752.434008:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855225344 00000100:00100000:0.0:1788918752.434063:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:0.0:1788918752.434075:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+5:2352:x1875816855225216:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918752.434148:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855225088 00000100:00100000:2.0:1788918752.434180:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855225088 00000100:00100000:0.0:1788918752.434180:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+5:2352:x1875816855225216:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 108us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918752.434188:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:0.0:1788918752.434208:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:2.0:1788918752.434214:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855225472 00000100:00100000:0.0:1788918752.434214:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+5:2352:x1875816855225344:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918752.434216:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855225472 00000100:00100000:2.0:1788918752.434238:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:0.0:1788918752.434239:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+5:2352:x1875816855225344:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 25us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918752.434245:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:2352:x1875816855225088:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918752.434245:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:0.0:1788918752.434266:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:2.0:1788918752.434277:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:2352:x1875816855225088:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 33us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918752.434284:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:0.0:1788918752.434285:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:2352:x1875816855225472:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788918752.434308:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:2352:x1875816855225472:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918752.434315:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00080000:0.0:1788918752.434337:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788918752.434343:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788918752.434345:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918752.436227:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855224960 00000100:00100000:1.0:1788918752.436242:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855224960 00000100:00100000:1.0:1788918752.436321:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 105 00000100:00100000:1.0:1788918752.436332:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:2352:x1875816855224960:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918752.436417:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:2352:x1875816855224960:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 86us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918752.436425:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 105 00000100:00100000:0.0:1788918752.442829:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918752.442881:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918752.442952:0:15773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855225600 00000100:00100000:1.0:1788918752.442952:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855225728 00000100:00100000:3.0:1788918752.442965:0:15773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855225600 00000100:00100000:1.0:1788918752.442965:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855225728 00000100:00100000:1.0:1788918752.443078:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00080000:0.0:1788918752.443087:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788918752.443091:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:2351:x1875816855225728:12345-192.168.202.49@tcp:400:kworker.0 00000100:00080000:0.0:1788918752.443092:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918752.443200:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:2351:x1875816855225728:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 112us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918752.443208:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:1.0:1788918752.443230:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:1.0:1788918752.443236:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+5:2351:x1875816855225600:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918752.443261:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+5:2351:x1875816855225600:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918752.443267:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000001:00100000:3.0:1788918752.857177:0:16587:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 45d3e96c-a7e2-451e-8a57-d44fd0c20215 00010000:00010000:3.0:1788918752.990487:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788918754.009647:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918754.390780:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788918754.390817:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865700864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918754.390915:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918754.391000:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865700864 00000100:00100000:2.0:1788918754.391010:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865700864 00000100:00100000:2.0:1788918754.391105:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788918754.391116:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865700864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788918754.391168:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923660800 avail 3692138496 00000100:00100000:0.0:1788918754.391178:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865700992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788918754.391225:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918754.391237:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865700864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918754.391257:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788918754.391278:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865700992 00000100:00100000:2.0:1788918754.391282:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865700992 00000100:00100000:2.0:1788918754.391298:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788918754.391304:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865700992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788918754.391320:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788918754.391354:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865700992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918754.391359:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788918754.391376:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788918754.391381:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788918754.391426:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865700992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788918754.391461:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865700864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788918754.392337:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865701120:0@lo:400:kworker.0 00000100:00100000:2.0:1788918754.392394:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918754.392437:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788918754.392456:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865701504:0@lo:400:kworker.0 00000100:00100000:2.0:1788918754.392488:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918754.392526:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865701120 00000100:00100000:2.0:1788918754.392532:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865701120 00000100:00100000:3.0:1788918754.392542:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865701376:0@lo:400:kworker.0 00000100:00100000:2.0:1788918754.392575:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788918754.392589:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3420:x1875816865701120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918754.392591:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918754.392628:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788918754.392637:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865701248:0@lo:400:kworker.0 00000100:00100000:2.0:1788918754.392645:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3420:x1875816865701120:12345-0@lo:400:kworker.0 Request processed in 59us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918754.392653:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788918754.392672:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918754.392706:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865701504 00000100:00100000:2.0:1788918754.392712:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865701504 00000100:00100000:2.0:1788918754.392756:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865701376 00000100:00100000:2.0:1788918754.392760:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865701376 00000100:00100000:2.0:1788918754.392775:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865701248 00000100:00100000:2.0:1788918754.392778:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865701248 00000100:00100000:2.0:1788918754.392791:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788918754.392797:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865701504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918754.392848:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865701504:12345-0@lo:400:kworker.0 Request processed in 51us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918754.392855:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788918754.392873:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788918754.392879:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865701376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918754.392919:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3418:x1875816865701376:12345-0@lo:400:kworker.0 Request processed in 40us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918754.392926:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788918754.392941:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788918754.392948:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865701248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918754.392982:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865701248:12345-0@lo:400:kworker.0 Request processed in 35us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918754.392989:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788918754.393013:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918754.393077:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865701504:0@lo:400:kworker.0 00000100:00100000:2.0:1788918754.393088:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865701120:0@lo:400:kworker.0 00000100:00100000:1.0:1788918754.393329:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3418:1875816865701376:0@lo:400:kworker.0 00000100:00100000:1.0:1788918754.393356:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865701248:0@lo:400:kworker.0 00000020:00000080:3.0:1788918754.644318:0:17290:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2e731e90 20000000:00000080:3.0:1788918754.644335:0:17290:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94fffc4d4800 uarg=0000000000000000 20000000:01000000:3.0:1788918754.644378:0:17290:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788918754.644385:0:17290:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788918754.644390:0:17290:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788918754.655250:0:17291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788918754.655973:0:17290:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788918754.664837:0:17290:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788918754.664981:0:17290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.665389:0:17290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac9e4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e46 expref: 18 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.665400:0:17290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fffcb21400/0x2811b8b2b0ac9e9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9e93 expref: 18 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.665407:0:17290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fffcbc5200/0x2811b8b2b0ac9fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0ac9fce expref: 18 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.665415:0:17290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94ffefbf5200/0x2811b8b2b0aca0f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f07c8 expref: 12 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.665422:0:17290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0aca12c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f082a expref: 12 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.665429:0:17290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.665475:0:17290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0aca12c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f082a expref: 12 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.665490:0:17290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0aca12c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f082a expref: 12 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918754.665504:0:17290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d82a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1875816865701632:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918754.665625:0:17290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94ffefbf5200/0x2811b8b2b0aca0f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f07c8 expref: 12 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.665634:0:17290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94ffefbf5200/0x2811b8b2b0aca0f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f07c8 expref: 12 pid: 14985 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918754.665650:0:17290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1875816865701760:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918754.665684:0:17290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fffcbc5200/0x2811b8b2b0ac9fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac9fce expref: 18 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.665691:0:17290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94fffcbc5200/0x2811b8b2b0ac9fd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9fce expref: 18 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918754.665699:0:17290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1875816865701888:0@lo:104: 00000100:00100000:2.0:1788918754.665737:0:17290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788918754.665809:0:17290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fffcb21400/0x2811b8b2b0ac9e9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac9e93 expref: 18 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.665817:0:17290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94fffcb21400/0x2811b8b2b0ac9e9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e93 expref: 18 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918754.665826:0:17290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d81880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1875816865702016:0@lo:104: 00000100:00100000:2.0:1788918754.665843:0:17290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788918754.670632:0:17290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac9e4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2811b8b2b0ac9e46 expref: 18 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.670650:0:17290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac9e4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e46 expref: 18 pid: 14983 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918754.670665:0:17290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1875816865702144:0@lo:104: 00000100:00100000:2.0:1788918754.670722:0:17290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918754.670844:0:14973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865701888 00000100:00100000:3.0:1788918754.670853:0:14973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865701888 00000100:00100000:3.0:1788918754.670901:0:14973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865702016 00000100:00100000:3.0:1788918754.670904:0:14973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865702016 00000100:00100000:3.0:1788918754.670922:0:14973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788918754.670932:0:14973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+4:17290:x1875816865701888:12345-0@lo:104: 00010000:00010000:3.0:1788918754.670947:0:14973:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9fd5 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918754.671000:0:14973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788918754.671006:0:14973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+4:17290:x1875816865701888:12345-0@lo:104: Request processed in 77us (5269us total) trans 0 rc 0/0 00010000:00010000:0.0:1788918754.671164:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918754.671172:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9fd5 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.671180:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0030000 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:0.0:1788918754.671184:0:14979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac9fd5 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.671193:0:14979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac9fd5 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788918754.671201:0:14979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac9fd5 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918754.671207:0:14979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788918754.671243:0:14979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9fd5 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.671250:0:14979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788918754.671271:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9fd5 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.671279:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc0030000/0x2811b8b2b0ac9fce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9fd5 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.671294:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918754.671296:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918754.671298:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918754.671320:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffffaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865702272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788918754.671370:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918754.671416:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865702272 00000100:00100000:0.0:1788918754.671420:0:14975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865702272 00010000:00010000:0.0:1788918754.671441:0:14975:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fffcbc5200/0x2811b8b2b0ac9fd5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9fce expref: 19 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918754.671464:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788918754.671471:0:14975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3420:x1875816865702272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788918754.671481:0:14975:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918754.671488:0:14975:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fffcbc5200/0x2811b8b2b0ac9fd5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9fce expref: 19 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.671498:0:14975:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fffcbc5200/0x2811b8b2b0ac9fd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9fce expref: 19 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.671514:0:14975:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918754.671544:0:14975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3420:x1875816865702272:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918754.671550:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788918754.671590:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffffaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865702272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788918754.674757:0:14973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788918754.674810:0:14973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788918754.674828:0:14973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+3:17290:x1875816865702016:12345-0@lo:104: 00010000:00010000:3.0:1788918754.674851:0:14973:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9e9a expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918754.674965:0:14973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788918754.674971:0:14973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+3:17290:x1875816865702016:12345-0@lo:104: Request processed in 153us (9127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918754.674978:0:14973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788918754.675143:0:14978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918754.675151:0:14978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9e9a expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.675159:0:14978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dce00 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:0.0:1788918754.675163:0:14978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac9e9a expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.675171:0:14978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac9e9a expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788918754.675184:0:14978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac9e9a expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918754.675190:0:14978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788918754.675242:0:14978:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9e9a expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.675249:0:14978:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788918754.675277:0:14978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9e9a expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.675285:0:14978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94fff48dce00/0x2811b8b2b0ac9e93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9e9a expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.675299:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918754.675301:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918754.675302:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918754.675328:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3417:1875816865702400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788918754.675368:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918754.675422:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865702400 00000100:00100000:0.0:1788918754.675429:0:14977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865702400 00010000:00010000:0.0:1788918754.675451:0:14977:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fffcb21400/0x2811b8b2b0ac9e9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e93 expref: 19 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918754.675474:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788918754.675480:0:14977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3417:x1875816865702400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788918754.675489:0:14977:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918754.675494:0:14977:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fffcb21400/0x2811b8b2b0ac9e9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e93 expref: 19 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.675509:0:14977:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fffcb21400/0x2811b8b2b0ac9e9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e93 expref: 19 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.675526:0:14977:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918754.675549:0:14977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3417:x1875816865702400:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918754.675555:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788918754.675587:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3417:1875816865702400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788918754.676061:0:17290:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe81600 going to sleep for 11 seconds 00010000:00010000:2.0:1788918754.676078:0:17290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fffcbc5200/0x2811b8b2b0ac9fd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac9fce expref: 18 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918754.676101:0:17290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1875816865701888:0@lo:104: 00010000:00010000:2.0:1788918754.676112:0:17290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fffcb21400/0x2811b8b2b0ac9e9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e93 expref: 17 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918754.676119:0:17290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d81880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1875816865702016:0@lo:104: 00000100:00100000:0.0:1788918754.676242:0:14973:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788918754.676256:0:14973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865702144 00000100:00100000:0.0:1788918754.676260:0:14973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865702144 00000100:00100000:0.0:1788918754.676283:0:14973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788918754.676289:0:14973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc5058850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+3:17290:x1875816865702144:12345-0@lo:104: 00010000:00010000:0.0:1788918754.676300:0:14973:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9e4d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.676363:0:14973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788918754.676368:0:14973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc5058850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+3:17290:x1875816865702144:12345-0@lo:104: Request processed in 80us (5646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918754.676373:0:14973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788918754.676406:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918754.676412:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2811b8b2b0ac9e4d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.676419:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffc0031200 already unused, calling callback (ffffffffc12e1c20) 10000000:00010000:0.0:1788918754.676422:0:14979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2811b8b2b0ac9e4d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.676442:0:14979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2811b8b2b0ac9e4d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788918754.676449:0:14979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2811b8b2b0ac9e4d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918754.676454:0:14979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788918754.676476:0:14979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9e4d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.676481:0:14979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788918754.676497:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9e4d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.676503:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff94ffc0031200/0x2811b8b2b0ac9e46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2811b8b2b0ac9e4d expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.676518:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918754.676520:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918754.676521:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918754.676531:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3418:1875816865702528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788918754.676563:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918754.676604:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865702528 00000100:00100000:0.0:1788918754.676607:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865702528 00010000:00010000:0.0:1788918754.676621:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac9e4d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e46 expref: 17 pid: 14983 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918754.676638:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788918754.676643:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffca31450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:3418:x1875816865702528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788918754.676658:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918754.676662:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac9e4d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e46 expref: 17 pid: 14983 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.676670:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac9e4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e46 expref: 17 pid: 14983 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918754.676683:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918754.676709:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffca31450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:3418:x1875816865702528:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918754.676715:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788918754.676762:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3418:1875816865702528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788918754.676972:0:17290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dd800/0x2811b8b2b0ac9e4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2811b8b2b0ac9e46 expref: 16 pid: 14983 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918754.676981:0:17290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d80a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1875816865702144:0@lo:104: 00000100:00100000:2.0:1788918754.680924:0:17290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d82a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1875816865701632:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788918754.680941:0:17290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17290:1875816865701760:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918754.680975:0:17290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918754.685549:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918754.685644:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855225856 00000100:00100000:2.0:1788918754.685654:0:14975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855225856 00010000:00010000:2.0:1788918754.685691:0:14975:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0aca12c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f082a expref: 13 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918754.685731:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:2.0:1788918754.685741:0:14975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:2349:x1875816855225856:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918754.685763:0:14975:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918754.685769:0:14975:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0aca12c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f082a expref: 13 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.685782:0:14975:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0aca12c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f082a expref: 13 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.685813:0:14975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff691ea00/0x2811b8b2b0aca12c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f082a expref: 13 pid: 14982 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.685827:0:14975:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918754.685878:0:14975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+12:2349:x1875816855225856:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 139us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918754.685885:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:0.0:1788918754.689870:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918754.690489:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855225984 00000100:00100000:2.0:1788918754.690499:0:14977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855225984 00010000:00010000:2.0:1788918754.690541:0:14977:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94ffefbf5200/0x2811b8b2b0aca0f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f07c8 expref: 12 pid: 14985 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918754.690622:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:2.0:1788918754.690632:0:14977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+12:2350:x1875816855225984:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918754.690647:0:14977:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918754.690652:0:14977:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94ffefbf5200/0x2811b8b2b0aca0f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f07c8 expref: 12 pid: 14985 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.690664:0:14977:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94ffefbf5200/0x2811b8b2b0aca0f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f07c8 expref: 12 pid: 14985 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.690682:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94ffefbf5200/0x2811b8b2b0aca0f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f07c8 expref: 12 pid: 14985 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.690700:0:14977:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.690708:0:14977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.690736:0:14977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.690744:0:14977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.690761:0:14977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.690767:0:14977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.690772:0:14977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc200 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918754.690777:0:14977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.690784:0:14977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.690804:0:14977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918754.690814:0:14977:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918754.690908:0:14977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+11:2350:x1875816855225984:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 277us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918754.690916:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00010000:00010000:3.0:1788918754.691143:0:17290:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918754.691163:0:17290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918754.691172:0:17290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94fff48dc200/0x2811b8b2b0aca156 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918755.030759:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788918756.055072:0:14987:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788918756.055080:0:14987:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94ffe8da4000 from 10 10000000:01000000:3.0:1788918756.055086:0:14987:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788918756.055146:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5400/0x2811b8b2b0aca15d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918756.055158:0:14987:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5400/0x2811b8b2b0aca15d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918756.055171:0:14987:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5400/0x2811b8b2b0aca15d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918756.055198:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865702656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788918756.055267:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918756.055330:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fbf00 going to sleep for 11 seconds 00010000:00010000:2.0:1788918756.055515:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918756.062533:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865702656 00000100:00100000:1.0:1788918756.062551:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865702656 00000100:00100000:1.0:1788918756.062622:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788918756.062633:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+16:14987:x1875816865702656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788918756.062662:0:14983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918756.062683:0:14983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fffcbc4400/0x2811b8b2b0aca164 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0aca15d expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918756.062730:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fffcbc4400/0x2811b8b2b0aca164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0aca15d expref: 17 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918756.062742:0:14983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fffcbc4400/0x2811b8b2b0aca164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0aca15d expref: 17 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918756.062753:0:14983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4400, rc 0) 00000100:00100000:1.0:1788918756.062826:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:14987:x1875816865702656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (7559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918756.062833:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788918756.063268:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865702656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918756.063299:0:14987:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5400/0x2811b8b2b0aca15d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0aca164 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918756.063322:0:14987:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5400/0x2811b8b2b0aca15d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0aca164 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918756.063407:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865702784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918756.063448:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918756.063491:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788918756.063614:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865702784 00000100:00100000:2.0:1788918756.063620:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865702784 00000100:00100000:2.0:1788918756.063663:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788918756.063678:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:14987:x1875816865702784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788918756.063805:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:14987:x1875816865702784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918756.063812:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788918756.064222:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865702784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918756.064255:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865702912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918756.064294:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918756.064332:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788918756.064439:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865702912 00000100:00100000:2.0:1788918756.064443:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865702912 00000100:00100000:2.0:1788918756.064479:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788918756.064487:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:14987:x1875816865702912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918756.064583:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:14987:x1875816865702912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918756.064590:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788918756.064809:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865702912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788918756.067415:0:17343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788918756.073415:0:14987:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788918756.073459:0:14987:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788918756.073472:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5400/0x2811b8b2b0aca15d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0aca164 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918756.073484:0:14987:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94ffefbf5400/0x2811b8b2b0aca15d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0aca164 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788918756.074271:0:14987:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788918756.074278:0:14987:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94ffc8961000 from 10 10000000:01000000:0.0:1788918756.074282:0:14987:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788918756.074339:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0aca16b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918756.074350:0:14987:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0aca16b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918756.074362:0:14987:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0aca16b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918756.074392:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865703040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788918756.074472:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918756.074545:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99300 going to sleep for 11 seconds 00000100:00100000:3.0:1788918756.074730:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865703040 00000100:00100000:3.0:1788918756.074738:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865703040 00000100:00100000:3.0:1788918756.074791:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788918756.074803:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+17:14987:x1875816865703040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918756.074817:0:14983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918756.074828:0:14983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffefbf4000/0x2811b8b2b0aca172 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0aca16b expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918756.074859:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffefbf4000/0x2811b8b2b0aca172 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0aca16b expref: 18 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918756.074870:0:14983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffefbf4000/0x2811b8b2b0aca172 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0aca16b expref: 18 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918756.074879:0:14983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4000, rc 0) 00000100:00100000:3.0:1788918756.074930:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:14987:x1875816865703040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918756.074936:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788918756.078690:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865703040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788918756.078739:0:14987:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0aca16b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0aca172 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918756.078753:0:14987:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0aca16b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0aca172 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918756.078853:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865703168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918756.078912:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918756.079159:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865703168 00000100:00100000:3.0:1788918756.079168:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865703168 00000100:00100000:3.0:1788918756.079215:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788918756.079225:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:14987:x1875816865703168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918756.079369:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:14987:x1875816865703168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918756.079377:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788918756.079525:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99300 going to sleep for 11 seconds 00000100:00100000:0.0:1788918756.079543:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865703168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918756.079575:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865703296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788918756.079622:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918756.079641:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0a99300 going to sleep for 11 seconds 00000100:00100000:2.0:1788918756.079740:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865703296 00000100:00100000:2.0:1788918756.079745:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865703296 00000100:00100000:2.0:1788918756.079775:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788918756.079782:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:14987:x1875816865703296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918756.079863:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:14987:x1875816865703296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918756.079870:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788918756.079914:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865703296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788918756.084479:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918756.089153:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855226112 00000100:00100000:3.0:1788918756.089168:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855226112 00000100:00100000:3.0:1788918756.089247:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 113 00000100:00100000:3.0:1788918756.089257:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+11:13677:x1875816855226112:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918756.089276:0:14982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918756.089297:0:14982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffefbf4a00/0x2811b8b2b0aca179 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f085b expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918756.089340:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffefbf4a00/0x2811b8b2b0aca179 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f085b expref: 12 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918756.089365:0:14982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffefbf4a00/0x2811b8b2b0aca179 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f085b expref: 12 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918756.089375:0:14982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4a00, rc 0) 00000100:00100000:3.0:1788918756.089442:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+12:13677:x1875816855226112:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 186us (4974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918756.089450:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 113 00000040:00080000:3.0:1788918756.098138:0:17344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:1.0:1788918756.099740:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000020:01000000:1.0:1788918756.099774:0:14987:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788918756.099807:0:14987:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788918756.099820:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0aca16b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0aca172 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918756.099834:0:14987:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fff691e800/0x2811b8b2b0aca16b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0aca172 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788918756.099844:0:14987:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788918756.099847:0:14987:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94fffcaab000 from 10 10000000:01000000:1.0:1788918756.099862:0:14987:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788918756.099898:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5400/0x2811b8b2b0aca180 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918756.099906:0:14987:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5400/0x2811b8b2b0aca180 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918756.099918:0:14987:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5400/0x2811b8b2b0aca180 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918756.099942:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffff847100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865703424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788918756.100001:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918756.100057:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbdc5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788918756.101652:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855226240 00000100:00100000:2.0:1788918756.101667:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855226240 00000100:00100000:2.0:1788918756.101723:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865703424 00000100:00100000:2.0:1788918756.101726:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865703424 00000100:00100000:2.0:1788918756.101747:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 114 00000100:00100000:2.0:1788918756.101757:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+12:13677:x1875816855226240:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788918756.101908:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+12:13677:x1875816855226240:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 151us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918756.101929:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 114 00000100:00100000:2.0:1788918756.101958:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788918756.101964:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+18:14987:x1875816865703424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918756.101972:0:14982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918756.101988:0:14982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94fff48ddc00/0x2811b8b2b0aca187 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2811b8b2b0aca180 expref: -99 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918756.102012:0:14982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94fff48ddc00/0x2811b8b2b0aca187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2811b8b2b0aca180 expref: 19 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918756.102066:0:14982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94fff48ddc00/0x2811b8b2b0aca187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2811b8b2b0aca180 expref: 19 pid: 14982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918756.102076:0:14982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48ddc00, rc 0) 00000100:00100000:2.0:1788918756.102139:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:14987:x1875816865703424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (2137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918756.102145:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788918756.106644:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918756.106682:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855226368 00000100:00100000:3.0:1788918756.106692:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855226368 00000100:00100000:3.0:1788918756.106758:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 116 00000100:00100000:3.0:1788918756.106769:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+12:13677:x1875816855226368:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918756.106912:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+12:13677:x1875816855226368:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 145us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918756.106920:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 116 00000100:00100000:2.0:1788918756.108641:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffff847100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865703424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788918756.108672:0:14987:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5400/0x2811b8b2b0aca180 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0aca187 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918756.108685:0:14987:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5400/0x2811b8b2b0aca180 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2811b8b2b0aca187 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918756.108778:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865703552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788918756.108834:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918756.108881:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe81900 going to sleep for 11 seconds 00000100:00100000:3.0:1788918756.111641:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865703552 00000100:00100000:3.0:1788918756.111653:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865703552 00000100:00100000:3.0:1788918756.111721:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788918756.111734:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:14987:x1875816865703552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788918756.111891:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:14987:x1875816865703552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (3056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918756.111900:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788918756.113187:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865703552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788918756.113273:0:14987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865703680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918756.113349:0:14987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918756.113384:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865703680 00000100:00100000:2.0:1788918756.113389:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865703680 00000100:00100000:2.0:1788918756.113422:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788918756.113428:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:14987:x1875816865703680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788918756.113522:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:14987:x1875816865703680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918756.113529:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788918756.113572:0:14987:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe81900 going to sleep for 11 seconds 00000100:00100000:2.0:1788918756.113584:0:14987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffe8d82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:14987:1875816865703680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788918756.117471:0:17347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788918756.117709:0:14987:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788918756.117743:0:14987:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788918756.117755:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5400/0x2811b8b2b0aca180 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0aca187 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918756.117767:0:14987:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff94fffcbc5400/0x2811b8b2b0aca180 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2811b8b2b0aca187 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918756.126668:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918756.126880:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855226496 00000100:00100000:3.0:1788918756.126897:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855226496 00000100:00100000:3.0:1788918756.126953:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 119 00000100:00100000:3.0:1788918756.126973:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+12:13677:x1875816855226496:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788918756.126990:0:14983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918756.127010:0:14983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94ffefbf4200/0x2811b8b2b0aca18e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x797745954e8f0862 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918756.127068:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94ffefbf4200/0x2811b8b2b0aca18e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0862 expref: 13 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918756.127080:0:14983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94ffefbf4200/0x2811b8b2b0aca18e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0862 expref: 13 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918756.127089:0:14983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4200, rc 0) 00000100:00100000:3.0:1788918756.127157:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13677:x1875816855226496:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 195us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918756.127164:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 119 00000100:00100000:3.0:1788918756.129553:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918756.129625:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855226624 00000100:00100000:0.0:1788918756.129635:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855226624 00000100:00100000:0.0:1788918756.129689:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00100000:0.0:1788918756.129698:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13677:x1875816855226624:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788918756.129867:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13677:x1875816855226624:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 169us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918756.129875:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00100000:1.0:1788918756.143970:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918756.144068:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855226752 00000100:00100000:3.0:1788918756.144131:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855226752 00000100:00100000:3.0:1788918756.144187:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 121 00000100:00100000:3.0:1788918756.144197:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13677:x1875816855226752:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788918756.144345:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:13677:x1875816855226752:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 149us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918756.144353:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 121 00010000:00010000:0.0:1788918757.084506:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918757.553450:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918757.553494:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918757.553532:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918757.553567:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918757.553589:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918757.553624:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918757.553650:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918757.553676:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855227008 00000100:00100000:2.0:1788918757.553685:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855227008 00000100:00100000:2.0:1788918757.553740:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855227392 00000100:00100000:2.0:1788918757.553744:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855227392 00000100:00100000:2.0:1788918757.553765:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:2.0:1788918757.553775:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:2349:x1875816855227008:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918757.553844:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:2349:x1875816855227008:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 71us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918757.553851:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:2.0:1788918757.553869:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:2.0:1788918757.553876:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:2349:x1875816855227392:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918757.553900:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:2349:x1875816855227392:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918757.553906:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00080000:2.0:1788918757.553923:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918757.554009:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855227264 00000100:00100000:1.0:1788918757.554063:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855227264 00000100:00100000:1.0:1788918757.554090:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855227520 00000100:00100000:1.0:1788918757.554093:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855227520 00000100:00100000:1.0:1788918757.554123:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855227136 00000100:00100000:1.0:1788918757.554126:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855227136 00000100:00100000:1.0:1788918757.554140:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855227648 00000100:00100000:1.0:1788918757.554142:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855227648 00000100:00100000:1.0:1788918757.554156:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:1.0:1788918757.554163:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+5:2349:x1875816855227264:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918757.554191:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+5:2349:x1875816855227264:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 29us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918757.554197:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:1.0:1788918757.554210:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:1.0:1788918757.554216:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+5:2349:x1875816855227520:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918757.554250:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+5:2349:x1875816855227520:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 34us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918757.554257:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:1.0:1788918757.554267:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788918757.554273:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+5:2349:x1875816855227136:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918757.554294:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+5:2349:x1875816855227136:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 22us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918757.554300:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788918757.554310:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:1.0:1788918757.554315:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+5:2349:x1875816855227648:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788918757.554335:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+5:2349:x1875816855227648:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 20us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918757.554341:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00080000:2.0:1788918757.554637:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788918757.554641:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788918757.554702:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855226880 00000100:00100000:3.0:1788918757.554707:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855226880 00000100:00100000:3.0:1788918757.554754:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 122 00000100:00100000:3.0:1788918757.554761:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:2349:x1875816855226880:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918757.554804:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:2349:x1875816855226880:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 43us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918757.554810:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 122 00010000:00010000:2.0:1788918758.102260:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788918758.736061:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918758.741505:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855227776 00000100:00100000:0.0:1788918758.741522:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855227776 00000100:00100000:0.0:1788918758.741618:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:0.0:1788918758.741649:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:14337:x1875816855227776:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788918758.741669:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918758.741691:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca195 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0869 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.741771:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca19c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.741785:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca19c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.741799:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca19c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.741814:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.741821:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.741828:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.741906:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0aca1aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.741915:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0aca1aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.741923:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0aca1aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918758.741980:0:14991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788918758.741984:0:14991:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788918758.742080:0:14991:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0aca1aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742104:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca19c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742111:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca19c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742118:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca19c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742124:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691ec00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918758.742128:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca19c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742135:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca19c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742148:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681ba00) 00010000:00010000:0.0:1788918758.742150:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918758.742156:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca19c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742161:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca19c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742175:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742193:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742198:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742203:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691fc00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918758.742206:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742212:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742221:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff94fff681b400) 00010000:00010000:0.0:1788918758.742223:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918758.742226:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742231:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742265:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0869 expref: 8 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742279:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f400/0x2811b8b2b0aca1aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0869 expref: 7 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.742286:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94fff681bc00) 00010000:00010000:0.0:1788918758.742288:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788918758.742297:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691f400, rc 0) 00000100:00100000:0.0:1788918758.742362:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:14337:x1875816855227776:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 716us (6355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918758.742369:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:0.0:1788918758.760170:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918758.762194:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855228032 00000100:00100000:3.0:1788918758.762213:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855228032 00000100:00100000:3.0:1788918758.762301:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:3.0:1788918758.762312:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:14337:x1875816855228032:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788918758.762334:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918758.762360:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca1b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0870 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762437:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca1b8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762461:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762475:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762532:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca1bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762540:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca1bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762547:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca1bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762683:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0aca1c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762692:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0aca1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762699:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0aca1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918758.762708:0:14992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788918758.762866:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762875:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca1b8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762882:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca1b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762888:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918758.762892:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca1b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762899:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca1b8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762910:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94fff681bc00) 00010000:00010000:3.0:1788918758.762913:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918758.762917:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca1b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762932:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca1b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762947:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca1bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762953:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca1bf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762959:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca1bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762964:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918758.762967:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca1bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762972:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca1bf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762980:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94ffe293df00) 00010000:00010000:3.0:1788918758.762982:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918758.762985:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca1bf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.762990:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca1bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.769332:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca1b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0870 expref: 10 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.769382:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5e00/0x2811b8b2b0aca1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0870 expref: 9 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918758.769391:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94ffe293dc00) 00010000:00010000:3.0:1788918758.769394:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918758.769398:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5e00, rc 0) 00000100:00100000:3.0:1788918758.769473:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+9:14337:x1875816855228032:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 7162us (9315us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788918758.769482:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:1.0:1788918758.772401:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918758.772503:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855228160 00000100:00100000:0.0:1788918758.772513:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855228160 00000100:00100000:0.0:1788918758.772576:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:0.0:1788918758.772588:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+9:14337:x1875816855228160:12345-192.168.202.49@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788918758.772697:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+9:14337:x1875816855228160:12345-192.168.202.49@tcp:59:lhsmtool_posix.0 Request processed in 111us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918758.772705:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00000040:00080000:3.0:1788918758.806776:0:15024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788918758.824247:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918758.824369:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855228288 00000100:00100000:0.0:1788918758.824381:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855228288 00000100:00100000:0.0:1788918758.824452:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:0.0:1788918758.824466:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+9:14343:x1875816855228288:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918758.824492:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918758.824528:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0877 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824605:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824623:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824635:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824667:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824676:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824683:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824723:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824731:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824737:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824743:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691fc00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918758.824747:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824754:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824766:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681ba00) 00010000:00010000:0.0:1788918758.824769:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918758.824774:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824781:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca1db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824800:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824807:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824811:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824816:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691ec00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918758.824819:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824825:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824833:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94fff681b400) 00010000:00010000:0.0:1788918758.824835:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918758.824838:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824843:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824874:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0877 expref: 10 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824885:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681ba00) 00010000:00010000:0.0:1788918758.824887:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918758.824897:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0877 expref: 10 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.824907:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691e200, rc 0) 00000100:00100000:0.0:1788918758.824984:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+9:14343:x1875816855228288:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 521us (749us total) trans 0 rc 301/301 00000100:00100000:0.0:1788918758.824992:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:3.0:1788918758.828649:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918758.829840:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855228416 00000100:00100000:2.0:1788918758.829853:0:14999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855228416 00000100:00100000:2.0:1788918758.829913:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:2.0:1788918758.829924:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+9:14343:x1875816855228416:12345-192.168.202.49@tcp:700:lfs.0 00000100:00100000:2.0:1788918758.830049:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+9:14343:x1875816855228416:12345-192.168.202.49@tcp:700:lfs.0 Request processed in 97us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918758.830071:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:1.0:1788918758.836372:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918758.836455:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855228672 00000100:00100000:0.0:1788918758.836466:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855228672 00000100:00100000:0.0:1788918758.836542:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:0.0:1788918758.836552:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+9:14343:x1875816855228672:12345-192.168.202.49@tcp:36:lfs.0 00010000:00010000:0.0:1788918758.836618:0:14991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918758.836644:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca117 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f07f2 expref: 9 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.836663:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681ba00) 00010000:00010000:0.0:1788918758.836668:0:14991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918758.836724:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.836739:0:14991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca14f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0854 expref: 5 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.836746:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.836784:0:14991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca14f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0854 expref: 5 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918758.836819:0:14991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca14f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0854 expref: 5 pid: 14992 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918758.836834:0:14991:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14991:1875816865703808:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918758.836946:0:14991:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788918758.838999:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918758.839794:0:14991:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14991:1875816865703808:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918758.839821:0:14991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918758.845845:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855228800 00000100:00100000:1.0:1788918758.845860:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855228800 00010000:00010000:1.0:1788918758.845927:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca14f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0854 expref: 6 pid: 14992 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918758.846014:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:1.0:1788918758.846041:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:2350:x1875816855228800:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918758.846057:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918758.846064:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca14f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0854 expref: 6 pid: 14992 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918758.846104:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca14f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0854 expref: 6 pid: 14992 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918758.846133:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca14f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0854 expref: 6 pid: 14992 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918758.846153:0:14976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681ba00) 00010000:00010000:1.0:1788918758.846159:0:14976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918758.846170:0:14976:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918758.846178:0:14976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918758.846218:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918758.846290:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+5:2350:x1875816855228800:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 253us (7300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918758.846297:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00010000:00010000:2.0:1788918758.846357:0:14991:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.846366:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.846392:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca1f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.846402:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.846411:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918758.853397:0:14991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788918758.853427:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.853442:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.853451:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.853457:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691e200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918758.853463:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.853473:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.853874:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681ba00) 00010000:00010000:2.0:1788918758.853879:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918758.853886:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.853894:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e200/0x2811b8b2b0aca1e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788918758.853925:0:14991:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed05e59d reply state 00000000619fc37e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918758.854146:0:14991:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788918758.854310:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+10:14343:x1875816855228672:12345-192.168.202.49@tcp:36:lfs.0 Request processed in 17753us (17941us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788918758.854321:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00010000:00010000:2.0:1788918758.857377:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.857401:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca1f0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.857411:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca1f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.857417:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918758.857423:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca1f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.857432:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca1f0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.857475:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94ffff5d1e00) 00010000:00010000:2.0:1788918758.857777:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918758.857788:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca1f0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918758.857797:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca1f0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918759.010766:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918759.010943:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855228928 00000100:00100000:0.0:1788918759.010953:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855228928 00000100:00100000:0.0:1788918759.011080:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:0.0:1788918759.011104:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+9:14351:x1875816855228928:12345-192.168.202.49@tcp:101:lctl.0 00010000:00010000:0.0:1788918759.011133:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918759.011159:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca1f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f087e expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.011221:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.011234:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.011246:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918759.011288:0:17055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788918759.011303:0:17055:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788918759.011342:0:17055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.011366:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca1f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f087e expref: 11 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.011384:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ec00/0x2811b8b2b0aca1fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f087e expref: 10 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.011393:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681b400) 00010000:00010000:0.0:1788918759.011396:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788918759.011399:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691ec00, rc 0) 00000100:00100000:0.0:1788918759.011469:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+10:14351:x1875816855228928:12345-192.168.202.49@tcp:101:lctl.0 Request processed in 379us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918759.011476:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00080000:2.0:1788918759.011647:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918759.053292:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918759.060648:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855229056 00000100:00100000:2.0:1788918759.060665:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855229056 00000100:00100000:2.0:1788918759.060767:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:2.0:1788918759.060776:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45d3e96c-a7e2-451e-8a57-d44fd0c20215+5:14352:x1875816855229056:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788918759.060795:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918759.060815:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca205 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0885 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.060875:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd200/0x2811b8b2b0aca20c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.060889:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd200/0x2811b8b2b0aca20c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.060900:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd200/0x2811b8b2b0aca20c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918759.061874:0:14990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788918759.061881:0:14990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918759.061907:0:14990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd200/0x2811b8b2b0aca20c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.061971:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0885 expref: 7 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.061991:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd200/0x2811b8b2b0aca20c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0885 expref: 6 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.062000:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681b400) 00010000:00010000:2.0:1788918759.062003:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788918759.062007:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd200, rc 0) 00000100:00100000:2.0:1788918759.062134:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:14352:x1875816855229056:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1358us (8851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918759.062143:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00080000:0.0:1788918759.062281:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788918759.065174:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918759.065285:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855229184 00000100:00100000:0.0:1788918759.065296:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855229184 00000100:00100000:0.0:1788918759.065356:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:0.0:1788918759.065365:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:14352:x1875816855229184:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918759.065385:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918759.065405:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f088c expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065469:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca21a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065482:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca21a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065508:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca21a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065526:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca221 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065533:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065540:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065686:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0aca228 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065695:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0aca228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065702:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0aca228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918759.065746:0:17055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788918759.065750:0:17055:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788918759.065771:0:17055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0aca228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065783:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca21a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065790:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca21a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065808:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca21a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065815:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691fc00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918759.065820:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca21a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065829:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca21a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065842:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681b400) 00010000:00010000:0.0:1788918759.065845:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918759.065851:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca21a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065858:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca21a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065872:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065879:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca221 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065885:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca221 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065891:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691e600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918759.065893:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca221 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065908:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca221 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065915:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94fff681be00) 00010000:00010000:0.0:1788918759.065917:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918759.065920:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca221 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065926:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca221 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065958:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f088c expref: 8 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065971:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0aca228 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f088c expref: 7 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.065978:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94fff681b700) 00010000:00010000:0.0:1788918759.065980:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788918759.065983:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691f800, rc 0) 00000100:00100000:0.0:1788918759.066096:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45d3e96c-a7e2-451e-8a57-d44fd0c20215+7:14352:x1875816855229184:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 724us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918759.066105:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:1.0:1788918759.072926:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918759.073117:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855229440 00000100:00100000:3.0:1788918759.073128:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855229440 00000100:00100000:3.0:1788918759.073191:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:3.0:1788918759.073201:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+7:14352:x1875816855229440:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918759.073223:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918759.073243:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca22f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0893 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918759.073343:0:14991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788918759.073445:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca22f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0893 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.073478:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681b400) 00010000:00010000:3.0:1788918759.073481:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788918759.073488:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca22f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0893 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.073502:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5a00, rc 0) 00000100:00100000:3.0:1788918759.074011:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+8:14352:x1875816855229440:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 809us (1093us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788918759.074065:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:2.0:1788918759.077473:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918759.077558:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855229696 00000100:00100000:0.0:1788918759.077571:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855229696 00000100:00100000:0.0:1788918759.077633:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:0.0:1788918759.077644:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45d3e96c-a7e2-451e-8a57-d44fd0c20215+8:14352:x1875816855229696:12345-192.168.202.49@tcp:36:lfs.0 00010000:00010000:0.0:1788918759.077712:0:17055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918759.077739:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0aca228 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f088c expref: 8 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.077757:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94fff681b700) 00010000:00010000:0.0:1788918759.077767:0:17055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788918759.077789:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca23d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.077801:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca23d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.077810:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca23d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788918759.078082:0:17055:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009655347 reply state 00000000ba8ec5fc transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca23d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918759.078105:0:17055:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788918759.078112:0:17055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788918759.078185:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45d3e96c-a7e2-451e-8a57-d44fd0c20215+9:14352:x1875816855229696:12345-192.168.202.49@tcp:36:lfs.0 Request processed in 542us (723us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788918759.078191:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 24 00010000:00010000:2.0:1788918759.081831:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca23d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.081853:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca23d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.081861:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca23d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.081867:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691f600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918759.081872:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca23d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.081879:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca23d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.081911:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94fff681be00) 00010000:00010000:2.0:1788918759.081914:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788918759.081929:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca23d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.081936:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f600/0x2811b8b2b0aca23d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918759.083262:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918759.083338:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855229952 00000100:00100000:3.0:1788918759.083348:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855229952 00000100:00100000:3.0:1788918759.083402:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:3.0:1788918759.083411:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+8:14352:x1875816855229952:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788918759.083643:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+9:14352:x1875816855229952:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 232us (386us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788918759.083650:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:1.0:1788918759.090412:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918759.090676:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855230208 00000100:00100000:3.0:1788918759.090686:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855230208 00000100:00100000:3.0:1788918759.090753:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:3.0:1788918759.090763:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+9:14352:x1875816855230208:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918759.090784:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918759.090803:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca244 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f089a expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.090871:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca24b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.090899:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca24b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.090911:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca24b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.090928:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca252 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.090944:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca252 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.090950:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca252 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918759.091079:0:14991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788918759.091156:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca24b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091164:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca24b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091171:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca24b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091177:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918759.091182:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca24b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091190:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca24b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091211:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681b400) 00010000:00010000:3.0:1788918759.091213:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918759.091218:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca24b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091225:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca24b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091241:0:14991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca252 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091247:0:14991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca252 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091252:0:14991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca252 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091257:0:14991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf5800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918759.091260:0:14991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca252 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091265:0:14991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca252 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091272:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94ffe293df00) 00010000:00010000:3.0:1788918759.091275:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918759.091277:0:14991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca252 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091283:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca252 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091331:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca244 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f089a expref: 11 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091341:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681b400) 00010000:00010000:3.0:1788918759.091343:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788918759.091347:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca244 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f089a expref: 11 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.091356:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5a00, rc 0) 00000100:00100000:3.0:1788918759.091421:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+10:14352:x1875816855230208:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 659us (1018us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788918759.091428:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:1.0:1788918759.101718:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918759.101827:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855230336 00000100:00100000:0.0:1788918759.101837:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855230336 00000100:00100000:0.0:1788918759.101895:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:0.0:1788918759.101906:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45d3e96c-a7e2-451e-8a57-d44fd0c20215+10:14352:x1875816855230336:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788918759.101941:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918759.101967:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0aca260 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08a1 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.102112:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca267 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.102126:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca267 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.102137:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca267 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918759.102163:0:17055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788918759.102166:0:17055:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788918759.102184:0:17055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca267 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.102209:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0aca260 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08a1 expref: 12 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.102226:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca267 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08a1 expref: 11 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.102235:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94fff681b700) 00010000:00010000:0.0:1788918759.102237:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788918759.102241:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691e600, rc 0) 00000100:00100000:0.0:1788918759.102306:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45d3e96c-a7e2-451e-8a57-d44fd0c20215+11:14352:x1875816855230336:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 401us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918759.102313:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:2.0:1788918759.106667:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918759.106833:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855230464 00000100:00100000:3.0:1788918759.106843:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855230464 00000100:00100000:3.0:1788918759.106899:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:3.0:1788918759.106910:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+11:14352:x1875816855230464:12345-192.168.202.49@tcp:37:lfs.0 00000100:00100000:2.0:1788918759.123059:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+11:14352:x1875816855230464:12345-192.168.202.49@tcp:37:lfs.0 Request processed in 16135us (16385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918759.123078:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 3 00010000:00010000:0.0:1788918759.126853:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918759.128686:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918759.128787:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855230720 00000100:00100000:2.0:1788918759.128796:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855230720 00000100:00100000:2.0:1788918759.128905:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:2.0:1788918759.128916:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45d3e96c-a7e2-451e-8a57-d44fd0c20215+11:14352:x1875816855230720:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:2.0:1788918759.129185:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45d3e96c-a7e2-451e-8a57-d44fd0c20215+12:14352:x1875816855230720:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 270us (507us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788918759.129192:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:3.0:1788918759.219339:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918759.219444:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855230848 00000100:00100000:2.0:1788918759.219454:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855230848 00000100:00100000:2.0:1788918759.219509:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:2.0:1788918759.219517:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+10:14358:x1875816855230848:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788918759.219536:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918759.219565:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca26e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08a8 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.219673:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca275 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.219687:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca275 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.219699:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca275 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.219714:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca27c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.219721:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca27c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.219727:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca27c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.219993:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0aca283 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220002:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0aca283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220009:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0aca283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918759.220108:0:14990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788918759.220112:0:14990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918759.220155:0:14990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0aca283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220179:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca275 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220186:0:14990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca275 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220192:0:14990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca275 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220198:0:14990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918759.220203:0:14990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca275 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220211:0:14990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca275 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220223:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681b400) 00010000:00010000:2.0:1788918759.220226:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918759.220231:0:14990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca275 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220237:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca275 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220250:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca27c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220256:0:14990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca27c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220261:0:14990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca27c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220273:0:14990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918759.220276:0:14990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca27c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220281:0:14990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca27c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220289:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94ffff5d1e00) 00010000:00010000:2.0:1788918759.220291:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918759.220294:0:14990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca27c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220299:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca27c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220332:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca26e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08a8 expref: 12 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220346:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd000/0x2811b8b2b0aca283 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08a8 expref: 11 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.220353:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94fff681b700) 00010000:00010000:2.0:1788918759.220355:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788918759.220357:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd000, rc 0) 00000100:00100000:2.0:1788918759.220424:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+11:14358:x1875816855230848:12345-192.168.202.49@tcp:101:bash.0 Request processed in 907us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918759.220432:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:1.0:1788918759.226454:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918759.230364:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855231104 00000100:00100000:0.0:1788918759.230398:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855231104 00000100:00100000:0.0:1788918759.230480:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:0.0:1788918759.230491:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+11:14358:x1875816855231104:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788918759.230521:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918759.230543:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0aca28a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08af expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.230671:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.230687:0:17055:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca267 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08a1 expref: 11 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.230696:0:17055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.230729:0:17055:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca267 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08a1 expref: 11 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.230741:0:17055:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca267 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08a1 expref: 11 pid: 17055 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918759.230754:0:17055:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17055:1875816865703936:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918759.230873:0:17055:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd820b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788918759.245899:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918759.245991:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855231232 00000100:00100000:2.0:1788918759.246015:0:14977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855231232 00010000:00010000:2.0:1788918759.246098:0:14977:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca267 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08a1 expref: 12 pid: 17055 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918759.246148:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:2.0:1788918759.246158:0:14977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+12:2349:x1875816855231232:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788918759.246173:0:14977:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918759.246180:0:14977:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca267 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08a1 expref: 12 pid: 17055 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.246194:0:14977:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca267 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08a1 expref: 12 pid: 17055 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.246219:0:14977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94fff681b700) 00010000:00010000:2.0:1788918759.246224:0:14977:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.246234:0:14977:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.246242:0:14977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.246262:0:14977:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788918759.246319:0:14977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+12:2349:x1875816855231232:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 162us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918759.246327:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00010000:00010000:0.0:1788918759.246792:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca267 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08a1 expref: 11 pid: 17055 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918759.246813:0:17055:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17055:1875816865703936:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918759.246845:0:17055:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.246856:0:17055:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.246862:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.246886:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0aca298 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.246896:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0aca298 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.246905:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0aca298 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.247430:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca29f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.247441:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca29f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.247448:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca29f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918759.247459:0:17055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788918759.247485:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.247492:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.247510:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.247517:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691fc00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918759.247521:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.247529:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.247538:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94fff681b700) 00010000:00010000:0.0:1788918759.247541:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918759.247544:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.247564:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca291 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788918759.247575:0:17055:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f734f0d reply state 00000000cace5fd9 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0aca298 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918759.247584:0:17055:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788918759.248719:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f800/0x2811b8b2b0aca28a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08af expref: 14 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.248740:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca29f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08af expref: 13 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.248748:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:0.0:1788918759.249161:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788918759.249166:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691f000, rc 0) 00000100:00100000:0.0:1788918759.249248:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+14:14358:x1875816855231104:12345-192.168.202.49@tcp:101:bash.0 Request processed in 18758us (22814us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788918759.249257:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 28 00010000:00010000:2.0:1788918759.252509:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0aca298 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.252541:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0aca298 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.252548:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0aca298 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.252563:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691fe00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918759.252568:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0aca298 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.252577:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0aca298 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.252594:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff94fff681b800) 00010000:00010000:2.0:1788918759.252597:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918759.252610:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0aca298 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.252617:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fe00/0x2811b8b2b0aca298 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918759.263628:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918759.263791:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855231360 00000100:00100000:2.0:1788918759.263801:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855231360 00000100:00100000:2.0:1788918759.263864:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:2.0:1788918759.263876:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+13:14358:x1875816855231360:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788918759.263900:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918759.263921:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca2ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08b6 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.264012:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0aca2b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.264059:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0aca2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.264071:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0aca2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918759.264134:0:14990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788918759.264138:0:14990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918759.264156:0:14990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0aca2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.264167:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0aca2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.264192:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca2ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08b6 expref: 15 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.264211:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0aca2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08b6 expref: 14 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.264220:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:2.0:1788918759.264223:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918759.264227:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dc800, rc 0) 00000100:00100000:2.0:1788918759.264282:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+14:14358:x1875816855231360:12345-192.168.202.49@tcp:101:bash.0 Request processed in 408us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918759.264289:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:1.0:1788918759.268142:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918759.268624:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855231616 00000100:00100000:0.0:1788918759.268634:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855231616 00000100:00100000:0.0:1788918759.268696:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:0.0:1788918759.268706:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+14:14358:x1875816855231616:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:0.0:1788918759.268995:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+15:14358:x1875816855231616:12345-192.168.202.49@tcp:35:bash.0 Request processed in 290us (861us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788918759.269004:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:0.0:1788918759.409186:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918759.416702:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855231872 00000100:00100000:3.0:1788918759.416720:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855231872 00000100:00100000:3.0:1788918759.418245:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:3.0:1788918759.418271:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+15:14368:x1875816855231872:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918759.418302:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918759.418328:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca2bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08bd expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918759.418428:0:14992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788918759.418551:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca2bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08bd expref: 17 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.418566:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681b400) 00010000:00010000:3.0:1788918759.418569:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788918759.418574:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca2bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08bd expref: 17 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.418589:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5a00, rc 0) 00000100:00100000:3.0:1788918759.418652:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+16:14368:x1875816855231872:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 392us (9476us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788918759.418660:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:1.0:1788918759.431374:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918759.431465:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855232128 00000100:00100000:0.0:1788918759.431477:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855232128 00000100:00100000:0.0:1788918759.431541:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:0.0:1788918759.431550:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+16:14368:x1875816855232128:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788918759.431784:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+17:14368:x1875816855232128:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 233us (420us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788918759.431792:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:1.0:1788918759.502307:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918759.502506:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855232384 00000100:00100000:2.0:1788918759.502516:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855232384 00000100:00100000:2.0:1788918759.502570:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:2.0:1788918759.502579:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+17:14371:x1875816855232384:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788918759.502602:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918759.502621:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca2c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08c4 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.502720:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca2d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.502734:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.502746:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca2d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918759.502756:0:14990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788918759.502850:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca2c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08c4 expref: 20 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.502868:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca2d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08c4 expref: 19 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918759.502876:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:2.0:1788918759.502879:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918759.502882:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd800, rc 0) 00000100:00100000:2.0:1788918759.502944:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+19:14371:x1875816855232384:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 366us (646us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788918759.502965:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:1.0:1788918759.506749:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918759.506858:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855232512 00000100:00100000:0.0:1788918759.506868:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855232512 00000100:00100000:0.0:1788918759.506938:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:0.0:1788918759.506949:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+19:14371:x1875816855232512:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:0.0:1788918759.507061:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca2de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.507107:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca2de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.507129:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca2de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.507167:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca2de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.507175:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca2de lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.507182:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca2de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.507188:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691fc00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918759.507193:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca2de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.507200:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca2de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.507211:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:0.0:1788918759.507215:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788918759.507219:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca2de lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.507226:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca2de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918759.507300:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+19:14371:x1875816855232512:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 352us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918759.507314:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:1.0:1788918759.508950:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918759.513488:0:3419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865704064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918759.513557:0:3419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918759.513645:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865704064 00000100:00100000:3.0:1788918759.513653:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865704064 00000100:00100000:3.0:1788918759.513708:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788918759.513718:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865704064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788918759.513748:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788918759.513792:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3419:x1875816865704064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918759.513799:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788918759.513822:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788918759.513857:0:3419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3419:1875816865704064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788918759.514231:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865704192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788918759.514272:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918759.514391:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865704448:0@lo:400:kworker.0 00000100:00100000:3.0:1788918759.514420:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918759.514441:0:3418:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788918759.514447:0:3418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3418:1875816865704320:0@lo:400:kworker.0 00000100:00100000:3.0:1788918759.514477:0:3418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918759.514503:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865704704:0@lo:400:kworker.0 00000100:00100000:3.0:1788918759.514525:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918759.514543:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788918759.514548:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865704576:0@lo:400:kworker.0 00000100:00100000:3.0:1788918759.514569:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788918759.514596:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865704448 00000100:00100000:3.0:1788918759.514601:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865704448 00000100:00100000:3.0:1788918759.514630:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865704704 00000100:00100000:3.0:1788918759.514633:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865704704 00000100:00100000:3.0:1788918759.514650:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865704576 00000100:00100000:3.0:1788918759.514653:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865704576 00000100:00100000:3.0:1788918759.514666:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788918759.514673:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865704448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918759.514711:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3418:x1875816865704448:12345-0@lo:400:kworker.0 Request processed in 38us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918759.514717:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788918759.514729:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788918759.514735:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865704704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918759.514765:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865704704:12345-0@lo:400:kworker.0 Request processed in 31us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918759.514772:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788918759.514783:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788918759.514797:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865704576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918759.514821:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3420:x1875816865704576:12345-0@lo:400:kworker.0 Request processed in 25us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918759.514826:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788918759.514839:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918759.514856:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3418:1875816865704448:0@lo:400:kworker.0 00000100:00100000:3.0:1788918759.514874:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3420:1875816865704576:0@lo:400:kworker.0 00000100:00100000:3.0:1788918759.514882:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865704704:0@lo:400:kworker.0 00000100:00100000:1.0:1788918759.515098:0:14982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865704320 00000100:00100000:1.0:1788918759.515103:0:14982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865704320 00000100:00100000:1.0:1788918759.515142:0:14982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788918759.515148:0:14982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3418:x1875816865704320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788918759.515184:0:14982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3418:x1875816865704320:12345-0@lo:400:kworker.0 Request processed in 36us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918759.515190:0:14982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788918759.515217:0:3418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3418:1875816865704320:0@lo:400:kworker.0 00000100:00100000:1.0:1788918759.515234:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865704192 00000100:00100000:1.0:1788918759.515238:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865704192 00000100:00100000:1.0:1788918759.515275:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788918759.515281:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865704192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918759.515299:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923660800 avail 3692138496 00000100:00100000:1.0:1788918759.515328:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3420:x1875816865704192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918759.515334:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788918759.515347:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788918759.515363:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefcb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865704192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788918759.515392:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855232640 00000100:00100000:1.0:1788918759.515395:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855232640 00000100:00100000:1.0:1788918759.515430:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:1.0:1788918759.515436:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+19:2352:x1875816855232640:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918759.515452:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918759.515473:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd800/0x2811b8b2b0aca2d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08c4 expref: 19 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918759.515491:0:14976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:1.0:1788918759.515496:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918759.515531:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+18:2352:x1875816855232640:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 95us (6602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918759.515537:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:1.0:1788918759.517833:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918759.518001:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855232896 00000100:00100000:0.0:1788918759.518010:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855232896 00000100:00100000:0.0:1788918759.518094:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:0.0:1788918759.518104:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+18:14371:x1875816855232896:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788918759.518486:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefcb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+19:14371:x1875816855232896:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 380us (658us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788918759.518502:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:1.0:1788918759.836790:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918759.836881:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855233152 00000100:00100000:3.0:1788918759.836896:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855233152 00000100:00100000:3.0:1788918759.836978:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:3.0:1788918759.836988:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+19:14402:x1875816855233152:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:3.0:1788918759.837012:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918759.837066:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca2e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08cb expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.837194:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca2ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.837211:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca2ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.837225:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca2ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918759.837238:0:14990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788918759.837359:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca2e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08cb expref: 22 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.837395:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca2ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08cb expref: 21 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.837404:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:3.0:1788918759.837406:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788918759.837409:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5800, rc 0) 00000100:00100000:3.0:1788918759.837476:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+21:14402:x1875816855233152:12345-192.168.202.49@tcp:101:cat.0 Request processed in 488us (695us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788918759.837483:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:3.0:1788918759.841699:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918759.841746:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918759.841983:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855233280 00000100:00100000:0.0:1788918759.841993:0:14975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855233280 00000100:00100000:0.0:1788918759.842108:0:14975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:0.0:1788918759.842119:0:14975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+21:2349:x1875816855233280:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918759.842137:0:14975:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918759.842163:0:14975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5800/0x2811b8b2b0aca2ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08cb expref: 21 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.842189:0:14975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:0.0:1788918759.842195:0:14975:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918759.842257:0:14975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+20:2349:x1875816855233280:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 141us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918759.842265:0:14975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:2.0:1788918759.849295:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855233536 00000100:00100000:2.0:1788918759.849310:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855233536 00000100:00100000:2.0:1788918759.849387:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:2.0:1788918759.849399:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+20:14402:x1875816855233536:12345-192.168.202.49@tcp:35:cat.0 00000100:00100000:2.0:1788918759.849699:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+21:14402:x1875816855233536:12345-192.168.202.49@tcp:35:cat.0 Request processed in 301us (7950us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788918759.849707:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:3.0:1788918759.961710:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918759.963457:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855233792 00000100:00100000:0.0:1788918759.963476:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855233792 00000100:00100000:0.0:1788918759.963568:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:0.0:1788918759.963583:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+21:14408:x1875816855233792:12345-192.168.202.49@tcp:101:dd.0 00010000:00010000:0.0:1788918759.963640:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918759.963664:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca2fa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08d2 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.963793:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca301 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.963809:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.963822:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788918759.963832:0:14991:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788918759.963980:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691fc00/0x2811b8b2b0aca2fa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08d2 expref: 24 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.964003:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca301 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08d2 expref: 23 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.964012:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:0.0:1788918759.964015:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788918759.964099:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691e600, rc 0) 00000100:00100000:0.0:1788918759.964175:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+23:14408:x1875816855233792:12345-192.168.202.49@tcp:101:dd.0 Request processed in 596us (2481us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788918759.964183:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:1.0:1788918759.971954:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918759.972010:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918759.972132:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855234048 00000100:00100000:0.0:1788918759.972147:0:14977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855234048 00000100:00100000:0.0:1788918759.972247:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:0.0:1788918759.972276:0:14977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffca33c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+23:2350:x1875816855234048:12345-192.168.202.49@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788918759.972313:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855233920 00010000:00010000:0.0:1788918759.972320:0:14977:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788918759.972324:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855233920 00010000:00010000:0.0:1788918759.972351:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e600/0x2811b8b2b0aca301 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08d2 expref: 24 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918759.972374:0:14977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:0.0:1788918759.972379:0:14977:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788918759.972396:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:3.0:1788918759.972410:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+23:14408:x1875816855233920:12345-192.168.202.49@tcp:101:dd.0 00010000:00010000:3.0:1788918759.972441:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788918759.972452:0:14977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffca33c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+23:2350:x1875816855234048:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 176us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918759.972462:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00010000:00010000:3.0:1788918759.972466:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca30f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08d9 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.972526:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca316 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.972546:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca316 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.972562:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca316 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.972713:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca30f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08d9 expref: 24 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.972734:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca316 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08d9 expref: 23 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.972760:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:3.0:1788918759.972763:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788918759.972766:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5a00, rc 0) 00000100:00100000:3.0:1788918759.972898:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+23:14408:x1875816855233920:12345-192.168.202.49@tcp:101:dd.0 Request processed in 491us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918759.972905:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:1.0:1788918759.982657:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918759.983180:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855234304 00000100:00100000:3.0:1788918759.983198:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855234304 00000100:00100000:3.0:1788918759.983310:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:3.0:1788918759.983332:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+23:14408:x1875816855234304:12345-192.168.202.49@tcp:36:dd.0 00010000:00010000:3.0:1788918759.983395:0:17055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918759.983425:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc800/0x2811b8b2b0aca2b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08b6 expref: 23 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.983447:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:3.0:1788918759.983453:0:17055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918759.983642:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca31d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.983656:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca31d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.983681:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca31d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788918759.983727:0:17055:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788918759.983767:0:17055:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e13d6307 reply state 00000000d9835117 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca31d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918759.983777:0:17055:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788918759.984586:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+25:14408:x1875816855234304:12345-192.168.202.49@tcp:36:dd.0 Request processed in 1254us (1944us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788918759.984596:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 36 00000020:00080000:3.0:1788918759.984603:0:17055:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788918759.993733:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca31d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.993750:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca31d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.993757:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca31d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.993762:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918759.993767:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca31d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.993775:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca31d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.993791:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:3.0:1788918759.993795:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918759.993815:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca31d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918759.993821:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca31d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918760.094437:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918760.094680:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855234560 00000100:00100000:2.0:1788918760.094692:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855234560 00000100:00100000:2.0:1788918760.094818:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:2.0:1788918760.094832:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+24:14408:x1875816855234560:12345-192.168.202.49@tcp:35:dd.0 00000100:00100000:2.0:1788918760.095193:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+25:14408:x1875816855234560:12345-192.168.202.49@tcp:35:dd.0 Request processed in 364us (773us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788918760.095200:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00010000:00010000:2.0:1788918760.152047:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918760.273466:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918760.273588:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855234688 00000100:00100000:3.0:1788918760.273602:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855234688 00000100:00100000:3.0:1788918760.273685:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00100000:3.0:1788918760.273696:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+25:14422:x1875816855234688:12345-192.168.202.49@tcp:101:stat.0 00010000:00010000:3.0:1788918760.273726:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918760.273749:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca324 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08e0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.273821:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca32b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.273834:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca32b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.273845:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca32b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.273856:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca332 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.273861:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca332 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.273866:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca332 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.274012:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0aca339 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.274042:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0aca339 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.274048:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0aca339 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918760.274109:0:14990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788918760.274114:0:14990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788918760.274166:0:14990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0aca339 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.274180:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0aca339 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.274190:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca32b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.274197:0:14990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca32b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.274205:0:14990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca32b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.274212:0:14990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918760.274217:0:14990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca32b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.274226:0:14990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca32b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.274248:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94fff681b700) 00010000:00010000:3.0:1788918760.274251:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918760.274257:0:14990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca32b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.274263:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca32b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.274280:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca332 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.274287:0:14990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca332 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.278052:0:14990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca332 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.278072:0:14990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918760.278086:0:14990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca332 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.278100:0:14990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca332 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.278126:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff94ffe293df00) 00010000:00010000:3.0:1788918760.278129:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918760.278136:0:14990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca332 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.278145:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca332 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.278281:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca324 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08e0 expref: 27 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.278300:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0aca339 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08e0 expref: 26 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.278308:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:3.0:1788918760.278310:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788918760.278313:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf5600, rc 0) 00000100:00100000:3.0:1788918760.278439:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+26:14422:x1875816855234688:12345-192.168.202.49@tcp:101:stat.0 Request processed in 4740us (4984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918760.278450:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00100000:1.0:1788918760.339695:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918760.339773:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855234944 00000100:00100000:0.0:1788918760.339787:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855234944 00000100:00100000:0.0:1788918760.339868:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00100000:0.0:1788918760.339880:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+26:14428:x1875816855234944:12345-192.168.202.49@tcp:36:truncate.0 00010000:00010000:0.0:1788918760.339955:0:14991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918760.339989:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5600/0x2811b8b2b0aca339 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08e0 expref: 26 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918760.340264:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:0.0:1788918760.340272:0:14991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788918760.340643:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0aca340 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.340677:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0aca340 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.340690:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0aca340 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788918760.340739:0:14991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1788918760.340763:0:14991:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083e6e073 reply state 00000000e79faaa2 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0aca340 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918760.340795:0:14991:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788918760.340945:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+28:14428:x1875816855234944:12345-192.168.202.49@tcp:36:truncate.0 Request processed in 1065us (1263us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788918760.340953:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 38 00000020:00080000:1.0:1788918760.340959:0:14991:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788918760.346464:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0aca340 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.346488:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0aca340 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.346511:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0aca340 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.346518:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918760.346525:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0aca340 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.346546:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0aca340 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.346571:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:2.0:1788918760.346574:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918760.346581:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0aca340 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.346588:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4800/0x2811b8b2b0aca340 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918760.523730:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918760.523932:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855235072 00000100:00100000:2.0:1788918760.523943:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855235072 00000100:00100000:2.0:1788918760.524005:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:2.0:1788918760.524014:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+27:14442:x1875816855235072:12345-192.168.202.49@tcp:101:stat.0 00010000:00010000:2.0:1788918760.524104:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918760.524131:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca347 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08e7 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524334:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca34e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524348:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca34e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524359:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca34e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524372:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca355 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524394:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524398:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524634:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca35c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524642:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca35c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524646:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca35c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918760.524778:0:14992:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788918760.524784:0:14992:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918760.524813:0:14992:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca35c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524827:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca35c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524836:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca34e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524843:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca34e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524850:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca34e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524867:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dce00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918760.524872:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca34e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524881:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca34e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524895:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94fff681b700) 00010000:00010000:2.0:1788918760.524897:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918760.524902:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca34e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524907:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca34e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524918:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca355 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524921:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca355 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524925:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca355 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524928:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918760.524930:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca355 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524933:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca355 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524945:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff94ffff5d1e00) 00010000:00010000:2.0:1788918760.524947:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918760.524948:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca355 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524952:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca355 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524983:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca347 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08e7 expref: 29 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524992:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca35c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08e7 expref: 28 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.524997:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:2.0:1788918760.524998:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918760.525000:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dca00, rc 0) 00000100:00100000:2.0:1788918760.525320:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+28:14442:x1875816855235072:12345-192.168.202.49@tcp:101:stat.0 Request processed in 1305us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918760.525328:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:1.0:1788918760.600428:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918760.600519:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855235328 00000100:00100000:3.0:1788918760.600532:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855235328 00000100:00100000:3.0:1788918760.600605:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:3.0:1788918760.600618:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+28:14452:x1875816855235328:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788918760.600645:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918760.600671:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca363 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08ee expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918760.600801:0:17055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788918760.600940:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca363 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08ee expref: 30 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.600957:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681b400) 00010000:00010000:3.0:1788918760.600961:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788918760.600984:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca363 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08ee expref: 30 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.601182:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4e00, rc 0) 00000100:00100000:3.0:1788918760.601312:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+29:14452:x1875816855235328:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 696us (896us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1788918760.601321:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:0.0:1788918760.607891:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918760.608005:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855235584 00000100:00100000:2.0:1788918760.608045:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855235584 00000100:00100000:2.0:1788918760.608137:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:2.0:1788918760.608149:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+29:14452:x1875816855235584:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:2.0:1788918760.608460:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+30:14452:x1875816855235584:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 312us (588us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788918760.608469:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788918760.650347:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918760.650414:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855235840 00000100:00100000:3.0:1788918760.650429:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855235840 00000100:00100000:3.0:1788918760.650625:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:3.0:1788918760.650639:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+30:14458:x1875816855235840:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788918760.650672:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918760.650697:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca371 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08f5 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.650831:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.650849:0:14990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca29f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08af expref: 31 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.650860:0:14990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca35c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08e7 expref: 31 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.650868:0:14990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.651642:0:14990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca35c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08e7 expref: 31 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.651683:0:14990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca35c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08e7 expref: 31 pid: 14992 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918760.651701:0:14990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe15880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14990:1875816865704832:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918760.651852:0:14990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca29f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08af expref: 31 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.651862:0:14990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca29f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08af expref: 31 pid: 17055 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918760.651872:0:14990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe17800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14990:1875816865704960:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918760.655713:0:14990:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fb780 going to sleep for 11 seconds 00000100:00100000:2.0:1788918760.656601:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918760.657136:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855235968 00000100:00100000:1.0:1788918760.657148:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855235968 00010000:00010000:1.0:1788918760.657268:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca35c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08e7 expref: 32 pid: 14992 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918760.657311:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:1.0:1788918760.657324:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+32:2349:x1875816855235968:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918760.657344:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918760.657352:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca35c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08e7 expref: 32 pid: 14992 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.657368:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca35c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08e7 expref: 32 pid: 14992 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.657394:0:14976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:1.0:1788918760.657400:0:14976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.657411:0:14976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.657434:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918760.657966:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca35c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08e7 expref: 32 pid: 14992 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918760.657990:0:14990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe15880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14990:1875816865704832:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918760.658002:0:14990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe17800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14990:1875816865704960:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788918760.659404:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918760.659631:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+31:2349:x1875816855235968:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 2308us (3037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918760.659645:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:1.0:1788918760.659682:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855236096 00000100:00100000:1.0:1788918760.659690:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855236096 00010000:00010000:1.0:1788918760.659723:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca29f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08af expref: 31 pid: 17055 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918760.659750:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:1.0:1788918760.659759:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+31:2350:x1875816855236096:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918760.659773:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918760.659780:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca29f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08af expref: 31 pid: 17055 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.659793:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca29f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08af expref: 31 pid: 17055 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.659814:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca29f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08af expref: 31 pid: 17055 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.659831:0:14976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:1.0:1788918760.659837:0:14976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.659848:0:14976:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.659872:0:14976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.659903:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918760.659943:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+30:2350:x1875816855236096:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 184us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918760.659950:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00010000:00010000:3.0:1788918760.660312:0:14990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.660325:0:14990:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.660332:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788918760.660364:0:14990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788918760.660545:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca371 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08f5 expref: 31 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.660564:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08f5 expref: 30 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.660573:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:3.0:1788918760.660576:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788918760.660578:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4800, rc 0) 00000100:00100000:3.0:1788918760.660608:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+30:14458:x1875816855235840:12345-192.168.202.49@tcp:101:bash.0 Request processed in 9973us (10273us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788918760.660615:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:2.0:1788918760.664771:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918760.664928:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855236352 00000100:00100000:1.0:1788918760.664944:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855236352 00000100:00100000:1.0:1788918760.665051:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:1.0:1788918760.665062:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+30:14458:x1875816855236352:12345-192.168.202.49@tcp:36:bash.0 00010000:00010000:1.0:1788918760.665419:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0aca386 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.665441:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0aca386 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.665455:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0aca386 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788918760.665521:0:14991:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1788918760.665546:0:14991:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c71b4a8 reply state 00000000799057b3 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0aca386 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918760.665559:0:14991:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788918760.665687:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+33:14458:x1875816855236352:12345-192.168.202.49@tcp:36:bash.0 Request processed in 622us (931us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1788918760.665695:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 42 00000020:00080000:1.0:1788918760.665701:0:14991:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788918760.667126:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0aca386 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.667146:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0aca386 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.667155:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0aca386 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.667162:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc4a00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918760.667169:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0aca386 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.667178:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0aca386 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.667283:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:3.0:1788918760.667286:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918760.667292:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0aca386 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.667299:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0aca386 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918760.668666:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918760.669004:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855236480 00000100:00100000:0.0:1788918760.669132:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855236480 00000100:00100000:0.0:1788918760.669482:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:0.0:1788918760.669501:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+32:14458:x1875816855236480:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788918760.669545:0:14992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918760.669570:0:14992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca38d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f08fc expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918760.669642:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca38d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08fc expref: 33 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918760.669659:0:14992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca38d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08fc expref: 33 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918760.669680:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:0.0:1788918760.669683:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788918760.669687:0:14992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691f200, rc 0) 00000100:00100000:0.0:1788918760.669763:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+33:14458:x1875816855236480:12345-192.168.202.49@tcp:101:bash.0 Request processed in 261us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918760.669771:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:0.0:1788918760.692562:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918760.693379:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855236608 00000100:00100000:3.0:1788918760.693398:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855236608 00000100:00100000:3.0:1788918760.693498:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:3.0:1788918760.693511:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+33:14458:x1875816855236608:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788918760.693540:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918760.693567:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca394 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0903 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.693714:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca39b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.693742:0:17055:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08f5 expref: 34 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.693753:0:17055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca39b lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.693799:0:17055:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08f5 expref: 34 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.693814:0:17055:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08f5 expref: 34 pid: 14990 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918760.693868:0:17055:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe17800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17055:1875816865705088:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788918760.699785:0:17055:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788918760.704675:0:17055:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe17800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17055:1875816865705088:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788918760.704717:0:17055:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca39b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918760.705567:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918760.705974:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855236736 00000100:00100000:1.0:1788918760.705985:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855236736 00010000:00010000:1.0:1788918760.706083:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08f5 expref: 35 pid: 14990 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918760.706123:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:1.0:1788918760.706135:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+35:2350:x1875816855236736:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788918760.706167:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788918760.706176:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08f5 expref: 35 pid: 14990 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.706191:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08f5 expref: 35 pid: 14990 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.706218:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca378 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08f5 expref: 35 pid: 14990 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.706240:0:14976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:1.0:1788918760.706246:0:14976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca39b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.706257:0:14976:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca39b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.706266:0:14976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca39b lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.706292:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788918760.706370:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+34:2350:x1875816855236736:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 238us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918760.706401:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00010000:00010000:2.0:1788918760.707260:0:17055:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca39b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.707273:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca39b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918760.708559:0:17055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788918760.708572:0:17055:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918760.708609:0:17055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca39b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.708675:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca394 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0903 expref: 34 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.708702:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca39b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0903 expref: 33 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.708712:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:2.0:1788918760.708716:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788918760.708720:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4600, rc 0) 00000100:00100000:2.0:1788918760.711729:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+33:14458:x1875816855236608:12345-192.168.202.49@tcp:101:bash.0 Request processed in 18201us (19163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918760.711763:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:0.0:1788918760.719607:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918760.719721:0:14975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855236992 00000100:00100000:2.0:1788918760.719798:0:14975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855236992 00000100:00100000:1.0:1788918760.720288:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:0.0:1788918760.720417:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+33:14458:x1875816855236992:12345-192.168.202.49@tcp:103:bash.0 00010000:00010000:0.0:1788918760.720438:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788918760.720475:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca38d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08fc expref: 33 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918760.720512:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4600/0x2811b8b2b0aca39b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0903 expref: 32 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918760.720558:0:14976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:0.0:1788918760.720565:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918760.720695:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+31:14458:x1875816855236992:12345-192.168.202.49@tcp:103:bash.0 Request processed in 395us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918760.720704:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:3.0:1788918760.724737:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918760.725291:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855237120 00000100:00100000:0.0:1788918760.725305:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855237120 00000100:00100000:0.0:1788918760.725385:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:0.0:1788918760.725398:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+31:14458:x1875816855237120:12345-192.168.202.49@tcp:58:bash.0 00010000:00010000:0.0:1788918760.725633:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e400/0x2811b8b2b0aca3a2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918760.725671:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e400/0x2811b8b2b0aca3a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918760.725694:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e400/0x2811b8b2b0aca3a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788918760.728415:0:14992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788918760.729099:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788918760.729454:0:14992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788918760.729665:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+31:14458:x1875816855237120:12345-192.168.202.49@tcp:58:bash.0 Request processed in 4261us (4945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918760.729756:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:1.0:1788918760.732288:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918760.732396:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855237248 00000100:00100000:3.0:1788918760.732409:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855237248 00000100:00100000:3.0:1788918760.732544:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:3.0:1788918760.732556:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+31:14458:x1875816855237248:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788918760.732585:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918760.732616:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0aca3a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f090a expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.732687:0:14991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e400/0x2811b8b2b0aca3a2 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.732700:0:14991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0aca3a9 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f090a expref: 32 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.732734:0:14991:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e400/0x2811b8b2b0aca3a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.732750:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0aca3a9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f090a expref: 32 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.732767:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:3.0:1788918760.732770:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788918760.732774:0:14991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0aca3a9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f090a expref: 32 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918760.732804:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4c00, rc 0) 00000100:00100000:3.0:1788918760.732879:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+32:14458:x1875816855237248:12345-192.168.202.49@tcp:101:bash.0 Request processed in 324us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918760.732887:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 46 00000040:00080000:3.0:1788918760.855922:0:15024:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788918760.855937:0:15024:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788918760.855972:0:15024:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788918760.855986:0:15024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788918760.856223:0:15024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe14e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:15024:1875816865705216:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788918760.857560:0:15024:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc91fb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788918760.865127:0:15024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe14e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:15024:1875816865705216:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788918760.871824:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918760.878129:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855237376 00000100:00100000:2.0:1788918760.878151:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855237376 00000100:00100000:2.0:1788918760.878243:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:2.0:1788918760.878255:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+32:14459:x1875816855237376:12345-192.168.202.49@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788918760.878379:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+32:14459:x1875816855237376:12345-192.168.202.49@tcp:900:lhsmtool_posix.0 Request processed in 126us (6572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918760.878388:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:1.0:1788918760.885000:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918760.890315:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855237504 00000100:00100000:3.0:1788918760.890340:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855237504 00000100:00100000:1.0:1788918760.890602:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:1.0:1788918760.890616:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+32:14459:x1875816855237504:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788918760.890659:0:14990:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788918760.890830:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+32:14459:x1875816855237504:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 216us (5958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918760.890839:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:1.0:1788918760.894795:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918760.895448:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855237632 00000100:00100000:2.0:1788918760.895462:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855237632 00000100:00100000:2.0:1788918760.895595:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:2.0:1788918760.895607:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+32:14459:x1875816855237632:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788918760.895716:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3b0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.895738:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.895752:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.901982:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902008:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902060:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902109:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca3be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902120:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca3be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902127:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca3be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918760.902180:0:17055:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788918760.902185:0:17055:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788918760.902206:0:17055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca3be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902219:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902226:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3b0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902233:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902239:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918760.902243:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902251:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3b0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902270:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94ffe293dc00) 00010000:00010000:2.0:1788918760.902273:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918760.902279:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902286:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902301:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902308:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3b7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902313:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902318:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918760.902322:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902328:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3b7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902336:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff94ffff5d1e00) 00010000:00010000:2.0:1788918760.902338:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918760.902341:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3b7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902347:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902375:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca3be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902382:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca3be lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902388:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca3be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902393:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dce00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918760.902396:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca3be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902403:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca3be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902412:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:2.0:1788918760.902415:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918760.902418:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca3be lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.902424:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca3be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918760.902524:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+32:14459:x1875816855237632:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 Request processed in 6915us (7739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918760.902534:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:3.0:1788918760.905454:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918760.905637:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855237888 00000100:00100000:1.0:1788918760.905650:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855237888 00000100:00100000:1.0:1788918760.905731:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:1.0:1788918760.905744:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+32:14459:x1875816855237888:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788918760.905773:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918760.905800:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0aca3c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0911 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.905948:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.905968:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.905983:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918760.906017:0:14990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788918760.906177:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.906186:0:14990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.906194:0:14990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.906202:0:14990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fffcbc5600 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:1.0:1788918760.906207:0:14990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.906216:0:14990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.906230:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:1.0:1788918760.906233:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788918760.906238:0:14990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3cc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.906245:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.906303:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0aca3c5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0911 expref: 34 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.906315:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94ffe293dc00) 00010000:00010000:1.0:1788918760.906317:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788918760.906328:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0aca3c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0911 expref: 34 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.906339:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5e00, rc 0) 00000100:00100000:1.0:1788918760.906420:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+33:14459:x1875816855237888:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 678us (983us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1788918760.906428:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:1.0:1788918760.911334:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918760.912291:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855238016 00000100:00100000:3.0:1788918760.912306:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855238016 00000100:00100000:3.0:1788918760.912385:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:3.0:1788918760.912399:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+33:14459:x1875816855238016:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788918760.912449:0:14991:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788918760.912635:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+33:14459:x1875816855238016:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 238us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918760.912644:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:2.0:1788918760.917267:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918760.917821:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855238272 00000100:00100000:1.0:1788918760.917837:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855238272 00000100:00100000:1.0:1788918760.917927:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:1.0:1788918760.917939:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+33:14459:x1875816855238272:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788918760.917963:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918760.917988:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0aca3da lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0918 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788918760.918579:0:14990:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1788918760.918589:0:14990:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788918760.918613:0:14990:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1788918760.918794:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.918813:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.918825:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.918889:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5e00/0x2811b8b2b0aca3da lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0918 expref: 36 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.918928:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0918 expref: 35 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.918937:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94fff48fc600) 00010000:00010000:1.0:1788918760.918941:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788918760.918945:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5600, rc 0) 00000100:00100000:1.0:1788918760.919096:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+35:14459:x1875816855238272:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 1159us (1839us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788918760.919105:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:0.0:1788918760.932116:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918760.932301:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855238528 00000100:00100000:2.0:1788918760.932314:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855238528 00000100:00100000:2.0:1788918760.932395:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:2.0:1788918760.932405:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+35:14459:x1875816855238528:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788918760.932466:0:17055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788918760.932505:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5600/0x2811b8b2b0aca3e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0918 expref: 35 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932527:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94fff48fc600) 00010000:00010000:2.0:1788918760.932538:0:17055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788918760.932561:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932576:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932587:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932602:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf37499a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932609:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf37499a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932615:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf37499a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932656:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932663:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3ef lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932679:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932685:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dd400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918760.932689:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932697:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3ef lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932705:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94fff681b700) 00010000:00010000:2.0:1788918760.932708:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918760.932712:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3ef lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932718:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca3ef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932728:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf37499a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932733:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf37499a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932738:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf37499a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932742:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff48dc200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918760.932745:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf37499a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932759:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3f6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf37499a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932781:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf37499a3 (ffff94ffff5d1e00) 00010000:00010000:2.0:1788918760.932784:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788918760.932787:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3f6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf37499a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.932793:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dc200/0x2811b8b2b0aca3f6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf37499a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918760.932878:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+34:14459:x1875816855238528:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 474us (776us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788918760.932886:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:2.0:1788918760.942365:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918760.942851:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855238656 00000100:00100000:1.0:1788918760.942871:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855238656 00000100:00100000:1.0:1788918760.942967:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:1.0:1788918760.942980:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+34:14459:x1875816855238656:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788918760.943008:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918760.943092:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0aca3fd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f091f expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.943142:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0aca404 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.943160:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0aca404 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.943175:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0aca404 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.943337:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4000/0x2811b8b2b0aca3fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f091f expref: 36 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.943367:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4e00/0x2811b8b2b0aca404 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f091f expref: 35 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918760.943377:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94fff48fcc00) 00010000:00010000:1.0:1788918760.943380:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788918760.943384:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc4e00, rc 0) 00000100:00100000:1.0:1788918760.943479:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+35:14459:x1875816855238656:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 501us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918760.943486:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:1.0:1788918760.946881:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918760.947174:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855238912 00000100:00100000:0.0:1788918760.947201:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855238912 00000100:00100000:0.0:1788918760.947296:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 54 00000100:00100000:0.0:1788918760.947311:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+35:14459:x1875816855238912:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788918760.947427:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca40b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918760.947449:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca40b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918760.947475:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca40b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788918760.947854:0:17055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788918760.947866:0:17055:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 463228844483ns, next at 464228841438ns, rc = 0 00000004:00010000:0.0:1788918760.947938:0:17055:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053bde2c5 reply state 00000000d03f1403 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca40b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918760.947949:0:17055:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788918760.948474:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+37:14459:x1875816855238912:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 1157us (1607us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788918760.948484:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 54 00010000:00010000:2.0:1788918760.957956:0:3403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca40b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.958241:0:3403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca40b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.958250:0:3403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca40b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.958256:0:3403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691f200 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:2.0:1788918760.958261:0:3403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca40b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.958270:0:3403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca40b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.958313:0:3403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94fff48fcc00) 00010000:00010000:2.0:1788918760.958316:0:3403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788918760.958322:0:3403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca40b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.958329:0:3403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f200/0x2811b8b2b0aca40b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918760.967718:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918760.967820:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855239040 00000100:00100000:2.0:1788918760.967830:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855239040 00000100:00100000:2.0:1788918760.967897:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:2.0:1788918760.967908:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+36:14459:x1875816855239040:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788918760.967937:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918760.967959:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca412 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0926 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.968083:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca412 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0926 expref: 37 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.968099:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca412 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0926 expref: 37 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918760.968120:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94fff48fcc00) 00010000:00010000:2.0:1788918760.968124:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788918760.968128:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dd400, rc 0) 00000100:00100000:2.0:1788918760.968184:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+37:14459:x1875816855239040:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 277us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918760.968207:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:3.0:1788918760.974820:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918760.976590:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855239168 00000100:00100000:1.0:1788918760.976604:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855239168 00000100:00100000:1.0:1788918760.976697:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:1.0:1788918760.976712:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+5:2349:x1875816855239168:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788918760.977661:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:2349:x1875816855239168:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 950us (2846us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788918760.977671:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00080000:3.0:1788918760.978128:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788918760.985380:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918760.985713:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855239424 00000100:00100000:2.0:1788918760.985724:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855239424 00000100:00100000:2.0:1788918760.986398:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:0.0:1788918761.006543:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+37:14459:x1875816855239424:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788918761.006866:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+38:14459:x1875816855239424:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 20456us (21494us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788918761.006876:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:2.0:1788918761.033572:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918761.033827:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855239680 00000100:00100000:3.0:1788918761.033852:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855239680 00000100:00100000:3.0:1788918761.033938:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00100000:3.0:1788918761.033950:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+38:14459:x1875816855239680:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788918761.034114:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+38:14459:x1875816855239680:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 167us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918761.034122:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00080000:1.0:1788918761.034189:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788918761.044401:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918761.044532:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855239808 00000100:00100000:1.0:1788918761.044542:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855239808 00000100:00100000:1.0:1788918761.044604:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:1.0:1788918761.044614:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+38:14459:x1875816855239808:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788918761.044635:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788918761.044669:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0aca419 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f092d expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918761.044743:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0aca420 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918761.044758:0:14990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0aca420 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918761.044769:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0aca420 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788918761.044814:0:14990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788918761.044833:0:14990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0aca420 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918761.044859:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc4a00/0x2811b8b2b0aca419 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f092d expref: 40 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918761.044878:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0aca420 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f092d expref: 39 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788918761.044888:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94fff48fcc00) 00010000:00010000:1.0:1788918761.044892:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788918761.044896:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fffcbc5200, rc 0) 00000100:00100000:1.0:1788918761.044977:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+39:14459:x1875816855239808:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 352us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918761.044985:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:2.0:1788918761.053190:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918761.054920:0:15773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855239936 00000100:00100000:3.0:1788918761.054934:0:15773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855239936 00000100:00100000:3.0:1788918761.055057:0:15773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:3.0:1788918761.055080:0:15773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffffa88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+6:2352:x1875816855239936:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788918761.055100:0:15773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918761.055121:0:15773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0aca427 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0934 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788918761.055146:0:15773:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0bbe7, blocks: 0x0 00010000:00010000:3.0:1788918761.055167:0:15773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1788918761.055172:0:15773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918761.055181:0:15773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0aca427 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0934 expref: 7 pid: 15773 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.055200:0:15773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0aca427 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0934 expref: 7 pid: 15773 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.055213:0:15773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4600, rc 0) 00000100:00100000:3.0:1788918761.055281:0:15773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffffa88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:2352:x1875816855239936:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 212us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918761.055305:0:15773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:2.0:1788918761.061793:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918761.061883:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855240192 00000100:00100000:3.0:1788918761.061894:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855240192 00000100:00100000:3.0:1788918761.061960:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:3.0:1788918761.061985:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+39:14459:x1875816855240192:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788918761.062138:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+39:14459:x1875816855240192:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 155us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918761.062145:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:2.0:1788918761.066285:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918761.066394:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855240320 00000100:00100000:1.0:1788918761.066405:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855240320 00000100:00100000:1.0:1788918761.066484:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:1.0:1788918761.066494:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+39:14459:x1875816855240320:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788918761.069916:0:14970:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1788918761.069941:0:14970:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788918761.077496:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94fff692e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865705344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788918761.077626:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918761.077785:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865705344 00000100:00100000:1.0:1788918761.077802:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865705344 00000100:00100000:1.0:1788918761.077900:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788918761.077912:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865705344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788918761.078090:0:15775:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788918761.078095:0:15775:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788918761.078097:0:15775:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788918761.078100:0:15775:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788918759 -> 1788918759 00002000:00010000:1.0:1788918761.078102:0:15775:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788918761.078180:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3417:x1875816865705344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 270us (554us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788918761.078186:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788918761.079083:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788918761.079156:0:3417:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94fff692e680/2, rc 0, transno 8589934595 00000100:00100000:0.0:1788918761.079166:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94fff692e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865705344:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1788918761.090206:0:14970:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788918761.091789:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+14:14459:x1875816855240320:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 Request processed in 25282us (25500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918761.091805:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:2.0:1788918761.095311:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918761.095420:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855240448 00000100:00100000:1.0:1788918761.095429:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855240448 00000100:00100000:1.0:1788918761.095496:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:1.0:1788918761.095511:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffe8d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:2349:x1875816855240448:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788918761.095625:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffe8d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:2349:x1875816855240448:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 Request processed in 115us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918761.095632:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:1.0:1788918761.116905:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918761.116996:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855240704 00000100:00100000:3.0:1788918761.117005:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855240704 00000100:00100000:3.0:1788918761.117098:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:3.0:1788918761.117108:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+14:14459:x1875816855240704:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788918761.117164:0:14991:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788918761.117192:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fffcbc5200/0x2811b8b2b0aca420 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f092d expref: 14 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.117211:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94fff48fcc00) 00010000:00010000:3.0:1788918761.117217:0:14991:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788918761.117246:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca42e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.117260:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca42e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.117287:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca42e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788918761.117415:0:14991:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005028acb9 reply state 000000008ed68f62 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca42e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918761.117424:0:14991:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788918761.117901:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+15:14459:x1875816855240704:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 792us (1003us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788918761.117909:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 60 00010000:00010000:3.0:1788918761.123230:0:3404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca42e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.123246:0:3404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca42e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.123254:0:3404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca42e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.123260:0:3404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4e00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:3.0:1788918761.123265:0:3404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca42e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.123274:0:3404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca42e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.123292:0:3404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94fff48fcc00) 00010000:00010000:3.0:1788918761.123295:0:3404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788918761.123300:0:3404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca42e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.123327:0:3404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4e00/0x2811b8b2b0aca42e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918761.124962:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918761.125277:0:15773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855240832 00000100:00100000:3.0:1788918761.125287:0:15773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855240832 00000100:00100000:3.0:1788918761.125335:0:15773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:3.0:1788918761.125344:0:15773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fff692d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:14459:x1875816855240832:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788918761.125362:0:15773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788918761.125380:0:15773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0aca435 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f093b expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.125411:0:15773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0aca427 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0934 expref: 8 pid: 15773 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.125421:0:15773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918761.125425:0:15773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918761.125430:0:15773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0aca435 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f093b expref: 8 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.125463:0:15773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0aca427 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0934 expref: 8 pid: 15773 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.125477:0:15773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0aca427 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0934 expref: 8 pid: 15773 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918761.125509:0:15773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe15c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15773:1875816865705472:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918761.126271:0:15773:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0aac9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788918761.131548:0:15773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe15c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15773:1875816865705472:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918761.131593:0:15773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0aca435 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f093b expref: 8 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.131614:0:15773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94ffefbf4800, rc 0) 00000100:00100000:3.0:1788918761.132016:0:15773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fff692d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+8:14459:x1875816855240832:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 6670us (7059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918761.132061:0:15773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:2.0:1788918761.140435:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918761.140844:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855240960 00000100:00100000:0.0:1788918761.140853:0:14977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855240960 00010000:00010000:0.0:1788918761.140896:0:14977:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0aca427 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0934 expref: 8 pid: 15773 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918761.141008:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:0.0:1788918761.141050:0:14977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+8:2350:x1875816855240960:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918761.141066:0:14977:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918761.141098:0:14977:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0aca427 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0934 expref: 8 pid: 15773 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.141125:0:14977:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0aca427 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0934 expref: 8 pid: 15773 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.141148:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008557af6d/0x2811b8b2b0aca427 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0934 expref: 8 pid: 15773 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.141166:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918761.141170:0:14977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918761.141178:0:14977:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0aca435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f093b expref: 7 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.141189:0:14977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0aca435 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f093b expref: 7 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.141246:0:14977:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0aca435 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f093b expref: 7 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918761.141260:0:14977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14977:1875816865705600:192.168.202.49@tcp:105: 00000100:00100000:0.0:1788918761.141342:0:14977:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe79900 going to sleep for 11 seconds 00000100:00100000:1.0:1788918761.148145:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918761.148266:0:14977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14977:1875816865705600:192.168.202.49@tcp:105: 00010000:00010000:0.0:1788918761.148289:0:14977:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918761.148333:0:14977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:2350:x1875816855240960:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 7317us (7909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918761.148343:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:2.0:1788918761.148420:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855241088 00000100:00100000:2.0:1788918761.148426:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855241088 00000100:00100000:2.0:1788918761.148473:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:2.0:1788918761.148489:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:2349:x1875816855241088:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788918761.148657:0:15775:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788918761.148661:0:15775:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788918759 00002000:00010000:2.0:1788918761.148663:0:15775:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788918758 00002000:00010000:2.0:1788918761.148665:0:15775:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788918759 -> 1788918759 00002000:00010000:2.0:1788918761.148668:0:15775:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788918761.148690:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+8:2349:x1875816855241088:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 203us (556us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788918761.148697:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:2.0:1788918761.154228:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918761.154456:0:15773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855241216 00000100:00100000:3.0:1788918761.154467:0:15773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855241216 00000100:00100000:3.0:1788918761.154536:0:15773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:3.0:1788918761.154545:0:15773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffff7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+8:2351:x1875816855241216:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788918761.154592:0:15773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.154612:0:15773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0aca435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0x797745954e8f093b expref: 8 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.154620:0:15773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788918761.154624:0:15773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788918761.154629:0:15773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.154676:0:15773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0aca435 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f093b expref: 8 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.154705:0:15773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0aca435 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f093b expref: 8 pid: 15773 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918761.155199:0:15773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe15c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15773:1875816865705728:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918761.155282:0:15773:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffd0aac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918761.160337:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918761.160439:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855241344 00000100:00100000:0.0:1788918761.160447:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855241344 00010000:00010000:0.0:1788918761.160496:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0aca435 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f093b expref: 9 pid: 15773 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918761.160550:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:0.0:1788918761.160559:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+9:2349:x1875816855241344:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918761.160574:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918761.160603:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0aca435 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f093b expref: 9 pid: 15773 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.160618:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0aca435 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f093b expref: 9 pid: 15773 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.160674:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788918761.160679:0:14976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788918761.160684:0:14976:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.160695:0:14976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.160715:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918761.161296:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+9:2349:x1875816855241344:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 735us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918761.161305:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00010000:00010000:3.0:1788918761.164084:0:15773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ba7515c/0x2811b8b2b0aca435 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0x797745954e8f093b expref: 8 pid: 15773 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918761.164109:0:15773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe15c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15773:1875816865705728:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918761.164135:0:15773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.164249:0:15773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.164259:0:15773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.164288:0:15773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.164297:0:15773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.164305:0:15773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.164313:0:15773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4e00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:2.0:1788918761.164317:0:15773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.164326:0:15773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.164343:0:15773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.164351:0:15773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffff9dd2/0x2811b8b2b0aca43c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918761.164902:0:15773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffff7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:2351:x1875816855241216:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 Request processed in 10356us (10681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918761.164975:0:15773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:1.0:1788918761.172609:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918761.173581:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855241600 00000100:00100000:0.0:1788918761.173698:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855241600 00000100:00100000:0.0:1788918761.173877:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:0.0:1788918761.173889:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+14:14459:x1875816855241600:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788918761.174216:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.174234:0:14992:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca316 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f08d9 expref: 14 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.174244:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.174274:0:14992:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca316 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08d9 expref: 14 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.174297:0:14992:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca316 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08d9 expref: 14 pid: 14990 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918761.174310:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14992:1875816865705856:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788918761.174431:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918761.174815:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe79a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788918761.177885:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14992:1875816865705856:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788918761.177975:0:14992:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788918761.180111:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918761.180673:0:14977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855241728 00000100:00100000:0.0:1788918761.180683:0:14977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855241728 00010000:00010000:0.0:1788918761.180837:0:14977:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca316 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08d9 expref: 15 pid: 14990 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918761.180881:0:14977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:0.0:1788918761.180890:0:14977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffca32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+15:2352:x1875816855241728:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918761.180904:0:14977:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918761.180921:0:14977:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca316 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08d9 expref: 15 pid: 14990 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.180934:0:14977:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca316 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08d9 expref: 15 pid: 14990 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.180955:0:14977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf5a00/0x2811b8b2b0aca316 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f08d9 expref: 15 pid: 14990 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.180991:0:14977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:0.0:1788918761.180997:0:14977:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0aca3a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f090a expref: 14 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.181008:0:14977:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.181015:0:14977:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.181060:0:14977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.181099:0:14977:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918761.181150:0:14977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffca32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+14:2352:x1875816855241728:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 262us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918761.181158:0:14977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00010000:00010000:3.0:1788918761.183306:0:14992:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.183322:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.184824:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.184848:0:14992:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca412 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0926 expref: 14 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.184856:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.184904:0:14992:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca412 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0926 expref: 14 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.184987:0:14992:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca412 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0926 expref: 14 pid: 14990 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788918761.185003:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14992:1875816865705984:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788918761.185241:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff94fffbe81240 going to sleep for 11 seconds 00000100:00100000:1.0:1788918761.196484:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918761.196676:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14992:1875816865705984:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788918761.196704:0:14992:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918761.198288:0:14976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855241856 00000100:00100000:0.0:1788918761.198301:0:14976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855241856 00010000:00010000:0.0:1788918761.198344:0:14976:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca412 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0926 expref: 15 pid: 14990 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918761.198402:0:14976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:0.0:1788918761.198411:0:14976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+15:2350:x1875816855241856:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788918761.198426:0:14976:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788918761.198432:0:14976:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca412 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0926 expref: 15 pid: 14990 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.198463:0:14976:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca412 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0926 expref: 15 pid: 14990 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.199016:0:14976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dd400/0x2811b8b2b0aca412 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0x797745954e8f0926 expref: 15 pid: 14990 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.199059:0:14976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94fff48fcc00) 00010000:00010000:0.0:1788918761.199065:0:14976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.199085:0:14976:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.199094:0:14976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.199128:0:14976:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788918761.199183:0:14976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+14:2350:x1875816855241856:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 772us (2716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918761.199191:0:14976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00010000:00010000:3.0:1788918761.200514:0:14992:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788918761.200529:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788918761.200979:0:14992:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1788918761.201155:0:14992:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1788918761.201190:0:14992:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1788918761.201284:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefe15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14992:1875816865706112:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788918761.202292:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788918761.202498:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc7050cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788918761.204928:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865706112 00000100:00100000:1.0:1788918761.204942:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865706112 00000100:00100000:1.0:1788918761.204997:0:14995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788918761.205007:0:14995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14992:x1875816865706112:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788918761.205314:0:14995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14992:x1875816865706112:12345-0@lo:1000:mdt00_002.0 Request processed in 309us (3024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918761.205323:0:14995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788918761.205508:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefe15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14992:1875816865706112:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788918761.205845:0:14992:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1788918761.205928:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14992:1875816865706240:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788918761.205967:0:14992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918761.205993:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc3ef5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788918761.206085:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865706240 00000100:00100000:3.0:1788918761.206091:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865706240 00000100:00100000:3.0:1788918761.206125:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788918761.206133:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14992:x1875816865706240:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788918761.206259:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14992:x1875816865706240:12345-0@lo:1000:mdt00_002.0 Request processed in 127us (292us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788918761.206267:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788918761.206835:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14992:1875816865706240:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788918761.206875:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.206892:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.206900:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.206906:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94ffefbf4800 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918761.206921:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.206930:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.206946:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94fff48fcc00) 00010000:00010000:0.0:1788918761.206949:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788918761.206953:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.206960:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4800/0x2811b8b2b0aca44a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.206992:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e400/0x2811b8b2b0aca3a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.206999:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e400/0x2811b8b2b0aca3a2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.207006:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e400/0x2811b8b2b0aca3a2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.207010:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691e400 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918761.207043:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e400/0x2811b8b2b0aca3a2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.207051:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e400/0x2811b8b2b0aca3a2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.207059:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:0.0:1788918761.207062:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788918761.207079:0:14992:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0aca3a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f090a expref: 17 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.207092:0:14992:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0aca3a9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f090a expref: 17 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.207102:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0aca3a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f090a expref: 17 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.207153:0:14992:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94ffefbf4c00/0x2811b8b2b0aca3a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f090a expref: 17 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918761.207165:0:14992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14992:1875816865706368:192.168.202.49@tcp:105: 00000100:00100000:0.0:1788918761.207239:0:14992:0:(client.c:2716:ptlrpc_set_wait()) set ffff94ffc3ef5900 going to sleep for 11 seconds 00000100:00100000:0.0:1788918761.209997:0:14992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14992:1875816865706368:192.168.202.49@tcp:105: 00010000:00010000:0.0:1788918761.210077:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e400/0x2811b8b2b0aca3a2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210090:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691e400/0x2811b8b2b0aca3a2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210145:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca451 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210161:0:14992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca451 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210174:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca451 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210183:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca451 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210190:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca451 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210195:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca451 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210201:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691ea00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918761.210205:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca451 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210213:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca451 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210223:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:0.0:1788918761.210226:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918761.210231:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca451 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210238:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca451 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210254:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210261:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210268:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210274:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691f000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918761.210277:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210284:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210292:0:14992:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:0.0:1788918761.210295:0:14992:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788918761.210298:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.210305:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca443 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14992 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788918761.211094:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+17:14459:x1875816855241600:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 37203us (38488us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788918761.211106:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 61 00000020:00080000:0.0:1788918761.211112:0:14992:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788918761.219374:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918761.219407:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855241984 00000100:00100000:0.0:1788918761.219428:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855241984 00000100:00100000:0.0:1788918761.219474:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:0.0:1788918761.219483:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+17:14458:x1875816855241984:12345-192.168.202.49@tcp:49:bash.0 00000100:00100000:0.0:1788918761.219605:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+17:14458:x1875816855241984:12345-192.168.202.49@tcp:49:bash.0 Request processed in 123us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918761.219613:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:0.0:1788918761.219710:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918761.219737:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855242240 00000100:00100000:0.0:1788918761.219740:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855242240 00000100:00100000:0.0:1788918761.219758:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:0.0:1788918761.219764:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+17:14459:x1875816855242240:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788918761.219974:0:14993:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788918761.220002:0:14993:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1788918761.220059:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca458 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.220087:0:14993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca458 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.220100:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca458 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.220109:0:14993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca458 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.220115:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca458 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.220122:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca458 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.220153:0:14993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788918761.220201:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+19:14459:x1875816855242240:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 436us (490us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1788918761.220209:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000020:00080000:0.0:1788918761.220212:0:14993:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788918761.220228:0:14979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788918761.220233:0:14979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca458 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.220240:0:14979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691ee00 already unused, calling callback (ffffffffc0cf94f0) 00010000:00010000:0.0:1788918761.220245:0:14979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca458 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.220254:0:14979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca458 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.220266:0:14979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff94fff48fcc00) 00010000:00010000:0.0:1788918761.220269:0:14979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788918761.220274:0:14979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca458 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.220280:0:14979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca458 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14993 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.220291:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918761.220293:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788918761.220294:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788918761.224096:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918761.225977:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855242368 00000100:00100000:0.0:1788918761.225989:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855242368 00000100:00100000:0.0:1788918761.226081:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:0.0:1788918761.226106:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+7:14458:x1875816855242368:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788918761.226124:0:15775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788918761.226144:0:15775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe552d68/0x2811b8b2b0aca45f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0942 expref: -99 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788918761.226168:0:15775:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa0bbe7, atime: 0x6aa0bbe6, ctime: 0x6aa0bbe7, blocks: 0x0 00010000:00010000:0.0:1788918761.226187:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788918761.226192:0:15775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788918761.226201:0:15775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe552d68/0x2811b8b2b0aca45f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0942 expref: 8 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.226218:0:15775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe552d68/0x2811b8b2b0aca45f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0942 expref: 8 pid: 15775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.226230:0:15775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff691f600, rc 0) 00000100:00100000:0.0:1788918761.226288:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+8:14458:x1875816855242368:12345-192.168.202.49@tcp:101:bash.0 Request processed in 185us (2203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918761.226295:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00000040:00080000:2.0:1788918761.227297:0:15024:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788918761.227303:0:15024:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788918761.227330:0:15024:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788918761.227335:0:15024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788918761.229302:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918761.229394:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855242496 00000100:00100000:3.0:1788918761.229403:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855242496 00000100:00100000:2.0:1788918761.229984:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00100000:2.0:1788918761.229997:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+19:14458:x1875816855242496:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788918761.230106:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918761.230130:0:14991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca466 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0949 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.230170:0:14991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca46d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.230183:0:14991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca46d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.230196:0:14991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca46d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.230307:0:14991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca466 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0949 expref: 21 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.230323:0:14991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dca00/0x2811b8b2b0aca46d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0949 expref: 20 pid: 14991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.230338:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:2.0:1788918761.230340:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788918761.230344:0:14991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dca00, rc 0) 00000100:00100000:2.0:1788918761.230419:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+20:14458:x1875816855242496:12345-192.168.202.49@tcp:101:bash.0 Request processed in 425us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918761.230426:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00100000:3.0:1788918761.240445:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918761.240522:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855242752 00000100:00100000:0.0:1788918761.240532:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855242752 00000100:00100000:0.0:1788918761.240591:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:0.0:1788918761.240601:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+20:14458:x1875816855242752:12345-192.168.202.49@tcp:35:bash.0 00000001:00080000:0.0:1788918761.240808:0:14993:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1788918761.240881:0:14993:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1788918761.240977:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+23:14458:x1875816855242752:12345-192.168.202.49@tcp:35:bash.0 Request processed in 377us (541us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1788918761.240994:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000020:00080000:0.0:1788918761.241000:0:14993:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788918761.395119:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918761.395216:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855243008 00000100:00100000:2.0:1788918761.395227:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855243008 00000100:00100000:2.0:1788918761.395284:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:2.0:1788918761.395294:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+23:14470:x1875816855243008:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788918761.395318:0:14990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788918761.395336:0:14990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca474 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x797745954e8f0950 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788918761.395427:0:14990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788918761.395537:0:14990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca474 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0950 expref: 25 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.395552:0:14990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94fff681b400) 00010000:00010000:2.0:1788918761.395555:0:14990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788918761.395561:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff48dce00/0x2811b8b2b0aca474 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0x797745954e8f0950 expref: 25 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788918761.395574:0:14990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94fff48dce00, rc 0) 00000100:00100000:2.0:1788918761.395633:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+24:14470:x1875816855243008:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 340us (522us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788918761.395654:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:3.0:1788918761.406127:0:3412:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918761.406230:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855243136 00000100:00100000:0.0:1788918761.406240:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855243136 00000100:00100000:0.0:1788918761.406298:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00100000:0.0:1788918761.406307:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+24:14470:x1875816855243136:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:0.0:1788918761.406377:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca482 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406395:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca482 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406407:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca482 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406421:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca489 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406429:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca489 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406435:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca489 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406747:0:17055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca490 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406757:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406764:0:17055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788918761.406819:0:17055:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406832:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca482 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406839:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca482 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406845:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406851:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691ee00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918761.406856:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406863:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca482 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406875:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94fff681b700) 00010000:00010000:0.0:1788918761.406878:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918761.406882:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca482 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406889:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ee00/0x2811b8b2b0aca482 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406901:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca489 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406908:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca489 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406918:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca489 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406924:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691f000 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918761.406927:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca489 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406933:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca489 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406940:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff94fff681b900) 00010000:00010000:0.0:1788918761.406942:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918761.406945:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca489 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406952:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691f000/0x2811b8b2b0aca489 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406964:0:17055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406970:0:17055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca490 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406976:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca490 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406981:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94fff691ea00 already unused, calling callback (ffffffffc18f24f0) 00010000:00010000:0.0:1788918761.406984:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca490 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.406997:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca490 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.407005:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94fff681b000) 00010000:00010000:0.0:1788918761.407007:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788918761.407010:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca490 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788918761.407016:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94fff691ea00/0x2811b8b2b0aca490 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17055 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788918761.407801:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+24:14470:x1875816855243136:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 1491us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918761.407812:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00100000:3.0:1788918761.410080:0:3411:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788918761.410205:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855243392 00000100:00100000:0.0:1788918761.410216:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855243392 00000100:00100000:0.0:1788918761.410281:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:0.0:1788918761.410291:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+24:14470:x1875816855243392:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788918761.410699:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+25:14470:x1875816855243392:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 408us (634us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1788918761.410708:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00010000:00010000:1.0:1788918762.198490:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788918762.678464:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918762.678511:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918762.678544:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918762.678546:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855243648 00000100:00100000:2.0:1788918762.678559:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855243648 00000100:00100000:3.0:1788918762.678575:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918762.678594:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918762.678612:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788918762.678619:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855244032 00000100:00100000:2.0:1788918762.678622:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855244032 00000100:00100000:3.0:1788918762.678634:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918762.678650:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855243904 00000100:00100000:3.0:1788918762.678654:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855243904 00000100:00100000:2.0:1788918762.678655:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:3.0:1788918762.678679:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855244160 00000100:00100000:2.0:1788918762.678679:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+25:2352:x1875816855243648:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918762.678682:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855244160 00000100:00100000:3.0:1788918762.678698:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855243776 00000100:00100000:3.0:1788918762.678701:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855243776 00000100:00100000:3.0:1788918762.678712:0:15775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855244288 00000100:00100000:3.0:1788918762.678715:0:15775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855244288 00000100:00100000:3.0:1788918762.678729:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:3.0:1788918762.678734:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+5:2352:x1875816855243904:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788918762.678789:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+5:2352:x1875816855243904:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 53us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918762.678812:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:3.0:1788918762.678832:0:15775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:3.0:1788918762.678838:0:15775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+5:2352:x1875816855244160:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918762.678934:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+25:2352:x1875816855243648:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 257us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918762.678941:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:2.0:1788918762.678963:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:2.0:1788918762.678970:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:2352:x1875816855244032:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918762.679012:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45d3e96c-a7e2-451e-8a57-d44fd0c20215+6:2352:x1875816855244032:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 42us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918762.679098:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:2.0:1788918762.679162:0:15776:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788918762.679178:0:15776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788918762.679202:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855243520 00000100:00100000:2.0:1788918762.679206:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855243520 00000100:00100000:2.0:1788918762.679233:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 124 00000100:00100000:2.0:1788918762.679239:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:2352:x1875816855243520:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918762.679283:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cac7e71b-3a4a-4e21-98c7-3442fe38ec4c+13:2352:x1875816855243520:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 44us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918762.679304:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 124 00000100:00100000:2.0:1788918762.679521:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:2.0:1788918762.679529:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+8:2352:x1875816855243776:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918762.679572:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+8:2352:x1875816855243776:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 44us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918762.679579:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:2.0:1788918762.679598:0:15776:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788918762.679606:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:2.0:1788918762.679612:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+5:2352:x1875816855244288:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788918762.679651:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45d3e96c-a7e2-451e-8a57-d44fd0c20215+5:2352:x1875816855244288:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 32us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918762.679667:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00080000:1.0:1788918762.681522:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788918762.681534:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788918762.681538:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788918762.682016:0:15775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45d3e96c-a7e2-451e-8a57-d44fd0c20215+5:2352:x1875816855244160:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 3168us (3462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918762.682047:0:15775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00010000:00010000:0.0:1788918763.222208:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788918763.481525:0:17440:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1788918764.246618:0:14978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788918764.630271:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788918764.630294:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865706496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918764.630383:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918764.630571:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865706496 00000100:00100000:1.0:1788918764.630580:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865706496 00000100:00100000:1.0:1788918764.630643:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788918764.630652:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865706496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788918764.630690:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923660800 avail 3692138496 00000100:00100000:1.0:1788918764.630737:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3417:x1875816865706496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918764.630744:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788918764.630850:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788918764.630887:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3417:1875816865706496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788918764.632151:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865706880:0@lo:400:kworker.0 00000100:00100000:0.0:1788918764.632197:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788918764.632233:0:3417:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788918764.632252:0:3417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865707008:0@lo:400:kworker.0 00000100:00100000:0.0:1788918764.632276:0:3417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918764.632628:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865706752:0@lo:400:kworker.0 00000100:00100000:1.0:1788918764.632677:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918764.632703:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffc70c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865707264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788918764.632722:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918764.632740:0:3420:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788918764.632745:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865706624:0@lo:400:kworker.0 00000100:00100000:1.0:1788918764.632769:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918764.632790:0:3420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94ffefc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865707136:0@lo:400:kworker.0 00000100:00100000:1.0:1788918764.632809:0:3420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788918764.632833:0:15778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865707264 00000100:00100000:1.0:1788918764.632839:0:15778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865707264 00000100:00100000:1.0:1788918764.632879:0:15778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788918764.632887:0:15778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3420:x1875816865707264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788918764.632909:0:15778:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17154624 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788918764.632946:0:15778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3420:x1875816865707264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918764.632952:0:15778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788918764.632988:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffc70c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865707264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788918764.633340:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865706880 00000100:00100000:2.0:1788918764.633344:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865706880 00000100:00100000:2.0:1788918764.633383:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865707008 00000100:00100000:2.0:1788918764.633386:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865707008 00000100:00100000:2.0:1788918764.633400:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865707136 00000100:00100000:2.0:1788918764.633402:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865707136 00000100:00100000:2.0:1788918764.633416:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788918764.633422:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865706880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918764.633477:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3417:x1875816865706880:12345-0@lo:400:kworker.0 Request processed in 55us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918764.633484:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788918764.633496:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788918764.633502:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865707008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918764.633539:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3417:x1875816865707008:12345-0@lo:400:kworker.0 Request processed in 37us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918764.633546:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788918764.633558:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788918764.633564:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865707136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788918764.633594:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3420:x1875816865707136:12345-0@lo:400:kworker.0 Request processed in 31us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788918764.633600:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788918764.633632:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3420:1875816865707136:0@lo:400:kworker.0 00000100:00100000:3.0:1788918764.634017:0:14983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865706624 00000100:00100000:3.0:1788918764.634058:0:14983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865706624 00000100:00100000:3.0:1788918764.634085:0:14983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788918764.634092:0:14983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94fffdb13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3420:x1875816865706624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788918764.634128:0:14983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94fffdb13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05d27ece-a3bf-4c95-8d2a-88ac445b15ff+19:3420:x1875816865706624:12345-0@lo:400:kworker.0 Request processed in 36us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788918764.634134:0:14983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788918764.634411:0:15776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816865706752 00000100:00100000:0.0:1788918764.634415:0:15776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816865706752 00000100:00100000:0.0:1788918764.634460:0:15776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788918764.634468:0:15776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffc70c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3420:x1875816865706752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788918764.634501:0:15776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffc70c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3420:x1875816865706752:12345-0@lo:400:kworker.0 Request processed in 34us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788918764.634506:0:15776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788918764.634523:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788918764.634528:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788918764.634551:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3417:1875816865707008:0@lo:400:kworker.0 00000100:00100000:0.0:1788918764.634562:0:3417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3417:1875816865706880:0@lo:400:kworker.0 00000100:00100000:2.0:1788918764.638347:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05d27ece-a3bf-4c95-8d2a-88ac445b15ff:3420:1875816865706624:0@lo:400:kworker.0 00000100:00100000:2.0:1788918764.638371:0:3420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94ffefc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3420:1875816865706752:0@lo:400:kworker.0 00000100:00100000:3.0:1788918765.235325:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788918765.235371:0:3410:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788918765.235665:0:15773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855244544 00000100:00100000:1.0:1788918765.235675:0:15773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855244544 00000100:00100000:1.0:1788918765.235736:0:15773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:1.0:1788918765.235747:0:15773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+8:2349:x1875816855244544:12345-192.168.202.49@tcp:16:kworker.0 00000100:00100000:1.0:1788918765.235855:0:15773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+8:2349:x1875816855244544:12345-192.168.202.49@tcp:16:kworker.0 Request processed in 111us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788918765.235862:0:15773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00080000:1.0:1788918765.235881:0:14986:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788918765.236525:0:15779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875816855244416 00000100:00100000:2.0:1788918765.236532:0:15779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875816855244416 00002000:00100000:2.0:1788918765.236562:0:15779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff94ffefd1aa00 x1875816855244416/t0(0) o4->e3eafaaf-3723-469d-8a5a-feb4556ed7a1@192.168.202.49@tcp:636/0 lens 504/0 e 0 to 0 dl 1788918776 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788918765.236571:0:15779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffefd1aa00 with x1875816855244416 ext(0->8) 00002000:00010000:2.0:1788918765.236576:0:15779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94ffefd1aa00 00000100:00100000:2.0:1788918765.236606:0:15779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:2.0:1788918765.236614:0:15779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94ffefd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+8:2349:x1875816855244416:12345-192.168.202.49@tcp:4:bash.0 00000100:00100000:3.0:1788918765.238730:0:15779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94ffefd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3eafaaf-3723-469d-8a5a-feb4556ed7a1+10:2349:x1875816855244416:12345-192.168.202.49@tcp:4:bash.0 Request processed in 2108us (3349us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788918765.238747:0:15779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00002000:00100000:3.0:1788918765.238758:0:15779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff94ffefd1aa00 x1875816855244416/t8589934598(0) o4->e3eafaaf-3723-469d-8a5a-feb4556ed7a1@192.168.202.49@tcp:636/0 lens 504/448 e 0 to 0 dl 1788918776 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788918765.238769:0:15779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94ffefd1aa00 with x1875816855244416 ext(0->8) 00002000:00010000:3.0:1788918765.238775:0:15779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94ffefd1aa00 00010000:00010000:0.0:1788918765.281224:0:14979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30185 lines, 30185 kept, 0 dropped, 0 bad.